PCT 



WORLD INTHXECTUAL PROPERTY ORGANIZATION 
IntcnixtiQzul Bureau 




INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATIO N TREATY (PCT) 
(51) International Patent Classification 6 : 
H04N 1/41, 7/26 



Al 



(11) International Publication Number: 
(43) Internationa] Publication Date: 



WO 96/09718 

28 March 1996 (28.03.96) 



(21) International Application Number: PCT/US95/ 12050 

(22) International FUlng Date: 21 September 1995 (21.09.95) 



(30) Priority Data: 

08/310,731 



22 September 1994 (22.09.94) US 



[ (71) Applicant: HOUSTON ADVANCED RESEARCH CENTER 
IUS/US]; 4800 Research Forest Drive, The Woodlands. TX 
77381 (US). 

(72) Inventors: CHUI, Charles, IC; 2120 Carter Lake Drive, College 
Station. TX 77840 (US). YUEN. Pak-Kay; 1528 Hillside 
Drive, College Station, TX 77840 (US). 

(74) Agents: ANDERSON, Rodney, M. et ai; Vinson & Elkins 
LU>, 2500 First City Tower. 1001 Fannin Street. Houston, 
TX 77002 (US). 



(81) Designated States: AM, AT, AU, BB, BG, BR, BY, CA, CFL 
CN, CZ, DE, DK. EE, ES, FI. GB, GE, HU, IS, JP. KE, 
KG, KP, KR, KZ, LK, LR, LT, LU, LV. MD, MG. MN, 
MW f MX, NO, NZ. PL, PT, RO. RU. SD, SE. SG, SI, SK, 
TJ, TM, TT, UA, UO, UZ, VN, European patent (AT, BE. 
CH, DE, DK, ES, FR, GB, GR, IE, IT, LU, MC, NL, PT. 
SE), OAPI patent (BF. BJ, CF, CG, O, CM, G A, GN, ML, 
MR, NE. SN, TO, TG). ARIPO patent (KE, MW, SD, SZ, 
UG). 



Published 

With international search report 
Before the expiration of the time limit for amending the 
claims and to be republished in the event of the receipt of 
amendments. 



I (54) Title: COMPRESSION AND DECOMPRESSION OF DOCUMENTS AND THE LIKE 



WAGE 
SOURCE 



FORMAT 
CONVERTER 

I 



SPUNE-WAVQET 
COMPRESSOR 



-20 j 
I 

■J 



-10 



25 

A. 




SPLINE-WAVELET ^ I L rr J 



DECOMPRESSOR 



I 



34d- 



r 






i 


«• 



FORMAT 
CONVERTER 



^40 J 



27 




(57) Abstract 



An apparatus and a corresponding method for performing compression and reconstruction of documents are disclosed. 
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COMPRESSION AND DECOMPRESSION OF DOCUMENTS AND THE LIKE 
TECHNICAL FIET.n O F THE TWyEjpTT '™ 

This invention is in the field of data compression, 
and more specifically is in the field of data compression 
of documents and similar images that may be represented 
as digital data. 

BACKGROUND OF TWP IKFVENJ TnM 

The increase in computational speed achieved by 
modern computer technology has enabled the widespread use 
of electronic techniques for the communication and 
storage of documents of many types. For purposes of this 
application, the term "documents" will refer to two- 
dimensional representations or renderings of a nature 
that are conventionally made on a paper medium or on a 
graphics display by writing, printing, typing, drawing, 
operation of a computer-aided draw, paint or design 
program, or other similar conventional techniques, and 
those renderings that are commonly stored on paper, 
microfilm, microfiche, or electronically. Examples of, 
such documents include, without limitation thereto, text 
documents, bank checks and other banking transaction 
records, vital records, maps, charts, printed works 
(including combinations of text and graphics) , seismic 
plots, medical records, bank and insurance records, 
directories, and the like. As is well known to the 
public, examples of conventional electronic communication 
and storage of documents includes modern digital 



WO 96/09718 



PCT/US95/120S0 



2 



facsimile ("fax") equipment, CD-ROM storage and 
distribution of encyclopedias and other series of books, 
electronically or magnetically stored representations of 
transactions such as checks and other banking 
5 transactions and statements, and the like. 

Electronic communication and storage is made quite 
difficult for those documents in which a significant 
portion of the information contained in many documents is 

10 in the form of graphic information which cannot readily 
be coded into computer- readable form on a character-by- 
character basis. For example, while the letters in a 
person's signature may readily be electronically 
communicated by way of an ASCII coded representation on a 

15 character -by-character basis, the retrieval of the ASCII 
coded representation will not provide any information 
regarding the appearance of the signature as made by the 
person. To electronically communicate or store documents 
with graphic information, the conventional technique is 

20 to digitize the document into a bit-map representation, 

with each memory location in the bit map corresponding to 
an elemental position of the document, and with the 
contents of the memory locations corresponding to the 
color at that location. In the case of a "binary" 

25 digital document representations, for example, the 

digital value "0" may be used to represent the color 
black and the digital value "1" may be used to represent 
the color white. 

30 Of course, it is highly desirable that the 

digitizing of documents be performed with as high a 
resolution as possible, which requires the use of a 
significant amount of memory for each document page. For 
example, current high resolution digitization devotes on 

35 the order of greater than one million bits to store a 

binary bit map representation of a single monochromatic 
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(black and white) document page divided into 1024-by-l024 
picture elements, or "pixels". On a 300 dpi laser 
printer, this lk-by-lk picture will be printed on a paper 
area of approximately three inches by three inches . 
Therefore, even finer resolution may be required for 
larger high quality pictures to be printed, and also for 
certain types of documents, such as fingerprint files 
utilized by law enforcement agencies. 

These high resolution digitally stored 
representations of documents obviously not only occupy a 
great deal of computer memory and hard disk storage 
space, but also require significant time for their 
transmission over conventional communication lines. As 
such, conventional data compression techniques are highly 
useful in the electronic communication and storage of 
documents. Conventional data compression techniques are 
generally referred to as of either "lossless" or "lossy", 
depending upon whether data is discarded in the 
compression process. For most digitized documents with 
graphics information, lossy data compression techniques 
may be used, so long as the receiver is still able to 
distinguish the graphic image with acceptable clarity. 

A survey of conventional lossy data compression 
techniques may be found at Simon, "How Lossy Data 
Compression Shrinks Image Files", PC Maaazir^ (j u l y 
1993), pp. 371 et seq. A popular one of these 
conventional lossy data compression techniques is 
referred to as the JPEG (Joint Photographic Experts 
Group) method. A description of this technique may be 
found in Barnsley and Hurd, Fractal image Compy^^ rr ( AK 
Peters. Ltd.. 1993), pp. 219-228. The JPEG compression 
method initially divides the image into blocks of pixels, 
and a Discrete Cosine Transform (DCT) is performed on 
each pixel block, producing a representation of the block 
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as coefficients corresponding to frequencies and 
amplitudes, rather than corresponding directly to color 
information. These coefficients are then quantized, or 
rounded off, and a difference algorithm is performed over 
5 all quantized blocks in the image, in a selected scan 
order. This difference algorithm subtracts a DC term 
corresponding to the mean pixel value of a block, from 
the DC term of the preceding block. The difference 
coefficients are then scanned in a different order, such 

10 as a zig-zag order, and the non-zero coefficients (i.e., 
blocks in which a difference from the preceding block 
occurred) are coded to indicate the number of preceding 
zero coefficients (i.e., the number of pixel blocks in 
which no change occurred) and also the value of the non- 

15 zero difference. Lossless compression is then often 

applied to the coded result to further compress the data. 
Decompression is performed by reversing the compression 
process, producing the displayable image. 

20 Another conventional method of lossy video image 

compression, referred to as Recursive Vector Quantization 
(RVQ) , quantizes the pixel blocks directly, without a DCT 
or other transform, according to a set of selected 
reference tiles. See Simon, July 1993, op, cit . . The 

25 reference tiles are selected according to an. iterative 
technique, based upon the accuracy of the results 
relative to the original image. As noted in the Simon 
article, compression according to the RVQ method is 
computationally intense and complex, but decompression 

30 can be done quite rapidly. 

Another type of conventional lossy video image 
compression techniques is referred to as fractal 
compression. As is well known in the art, a fractal is a 
35 mathematical image object that is self -similar , in that 
the image can be represented in terms of other pieces of 
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the image. In fractal image compression, the input image 
is similarly divided into pixel groups, or tiles. Each 
tile is then approximated by a transformation 
(contractive, rotational, or both) of one or more other 
reference regions of the image. The compressed image 
thus consists of a full representation of the reference 
region, plus the transformation operators for each of the 
tiles. Each tile of the image is decompressed by 
performing a transformation of the reference region using 
the stored transformation operator for that tile. 
Detailed descriptions of conventional fractal image 
compression techniques and systems for performing the 
same may be found in Barnsley & Hurd, Fractal Tm ag » 
Compress i op (AK Peters, Ltd., 1993), in U.S. Patent No. 
4,941,193, and in U.S. Patent No. 5,065,447. 

Wavelet -based techniques are also known to be used 
for the data compression of digitally stored documents. 
An summary of this technique, as applied to the 
compression of digitized fingerprint files used in law 
enforcement, is described in Bradley and Brislawn, "The 
Wavelet/Scalar Quantization Compression Standard for 
Digital Fingerprint Images", Tec. Rep. LA-UR-94-827, 
Proc. IEEF; TSCAfl-94 (IEEE, 1994) . This approach utilizes 
the well-known Daubechies wavelet, applied to the 
document data by way of a table look-up technique. The 
Daubechies wavelet function used in this case is not 
bounded, however, and as such boundary effects may be * 
present in the reconstruction; indeed, the approach 
described in the Bradley and Brislawn paper attempts to 
reduce boundary effects by reflecting the wavelet filters 
at the image boundaries. Furthermore, this prior 
approach is generalized to 8-bit images (i.e., for 
compression of full grey scale images) . Use of this 
approach for documents, particularly for binary 
documents, will thus be especially cumbersome considering 



WO 96/09718 



PCT/US95/12050 



6 



the size of the array to be considered in the image 
compression process, and the eventual compression ratio 
will be somewhat limited. 

5 By way of further background, the technique of byte 

packing as a lossless compression technique is well known 
in the field of computer data storage. According to this 
well-known technique, digital values that may be 
expressed by fewer bits are packed with other similar 

10 values into a single byte. For example, if eight bit 
words are used to express a stream of data having only 
two values, e.g., 255 2 and 0 2 , byte packing will allow the 
data stream to be expressed with a single bit per value. 
Each byte {eight bits) will thus be able to express the 

15 same information as eight bytes of raw data. 

By way of further background, our copending 
application S.N. 08/181,663, filed January 14, 1994, 
entitled "Method and Apparatus for Video Image 

20 Compression and Decompression Using Boundary -Spline- 
Wavelets", assigned to Houston Advanced Research Center 
and incorporated herein by this reference, describes a 
wavelet analysis -based approach to video compression, 
particularly in the field of motion pictures. This 

25 application S.N. 08/181,663 also provides a discussion of 
the background theory of wavelet analysis, and its 
application to image compression. 

It is an object of the present invention to provide 
3 0 a method and apparatus for compressing digitized 

representation of documents to a high degree, in such a 
manner that the resolution and fidelity of the received 
document upon decompression is maintained. 

35 It is a further object of the present invention to 

provide such a method and apparatus in which the 
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decompressed document may be magnified to an arbitrary 
extent . 



It is a further object of the present invention to 
provide such a method and apparatus in which boundary 
effects are effectively eliminated in the compressed 
document, thus improving the quality of the compressed 
document and also enabling zoom-in and zoom-out 
techniques to be applied to the reconstructed document. 

It is a further object of the present invention to 
provide such a method and apparatus in which the 
compression may be performed by integer operations, 
increasing the speed of the compression and enabling 
relatively low cost computing equipment (or hardware) to 
perform the compression quickly. 

It is a further object of the present invention to 
provide such a method and apparatus that is suitable for 
storage and communication of compressed digitized 
documents . 

It is another object of the present invention to 
provide such a method and apparatus in which the 
compression technique is selectable. 

Other objects and advantages of the present 
invention will be apparent to those of ordinary skill ^in 
the art having reference to the following specification 
together with its drawings. 
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SUMMARY OF THE INVENTION 

The present invention may be implemented into a 
system and method for communicating, or storing and 
5 retrieving, a compressed digital representation of a 

document. The input document is first digitized, and the 
system will perform a graphics format packing procedure 
according to either an automatic or manual mode of 
operation. For the automatic mode, the system will 

10 determine the maximum bit representation of the document 
and will send the information to a byte packing 
operation; for the manual mode, a dithering technique 
will be used to dither the document to a bit map with the 
exact bit representation required by the user. Byte 

15 packing compression is then performed on a row-by-row 
basis, in effect converting the digital representation 
into a Portable Grey Level (PGM) format. The PGM format 
document is then decomposed according to a wavelet 
analysis technique, followed by lossless compression if 

20 desired. The compressed decomposed document may then be 
stored or communicated over conventional communication 
networks. Decompression and reconstruction of the 
document is performed by reversal of the compression and 
decompression processes, at the receiving end, for 

25 display of the document. 

The present invention is based on finite elements, 
or splines. Hence, although the operations are in 
digital formats, the results are in an analog format, 

30 such that information can be extracted from anywhere in 

the result to improve the display resolution with real- 
time efficiency. In addition, the use of boundary 
wavelets according to the present invention eliminate 
boundary effects. Each of these two attributes separate 

3 5 the present invention from conventional compression 

technology. 
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Furthermore, according to the present invention, 
binary operations may be used to advantage at any stage 
of the process. This is made possible from the use of 
integer coefficients in the decomposition and 
reconstruction filters. According to one of the 
alternative embodiments, the use of dual bases is also 
accomplished by integer sequences filters, and allows the 
user to choose a shorter, and computationally more 
efficient, filter at either or both of the compression or 
decompression ends. A second alternative embodiment, 
namely interpolator wavelets, provides highest 
efficiency compression and decompression, while a third 
alternative embodiment, namely wavelet packets, provides 
the highest quality compression and decompression by way 
of full -tree decomposition and reconstruction. 

BRIEF DESCRIPTION OF THE nP&WT^ c 

Figure 1 is an electrical diagram, in block form, of 
a communications and storage system according to the 
preferred embodiment of the invention. 

Figure 2 is a flow diagram illustrating the 
operation of the system of Figure 1 in compressing 
document data according to the preferred embodiment of 
the invention. 

Figure 3a is an electrical diagram, in block form> 
of the format converter of the system of Figure 1, and 
Figures 3b and 3c are flow diagrams illustrating the 
automatic and manual operation modes, respectively, of 
the format converter of Figure 3a, according to 
alternative embodiments thereof. 
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Figure 4 is an electrical diagram, in block form, of 
the spline -wavelet compressor of the system of Figure 1, 
according to the preferred embodiment of the invention. 

5 Figures 5a and 5b are tree diagrams illustrating the 

decomposition and reconstruction of a signal function 
according to spline-wavelet techniques. 

Figure 6 is a graphical illustrations of the 
10 cardinal B-spline scaling function utilized according to 
the preferred embodiment of the invention. 

Figure 7 is a flow diagram illustrating the general 
procedure for spline -wavelet decomposition of a document 
15 according to the preferred embodiment of the invention. 

Figure 8 is a flow diagram illustrating the 
procedure for spline -wavelet decomposition of a document 
according to a first alternative implementation of the 
20 invention, specifically the dual-base technique. 

Figure 9 is an illustration of the operation of the 
process of Figure 8 . 

25 Figures 10a and 10b are plots of the scaling 

function and wavelet function utilized according to a 
second alternative implementation of the invention, 
specifically the interpolatory wavelet technique. 

30 Figures 11a and lib are full- tree representations of 

the decomposition and reconstruction, respectively, of a 
signal function according to spline -wavelet techniques, 
including a third alternative implementation of the 
invention utilizing wavelet packets. 



35 
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Figures 12a and 12b are flow diagrams illustrating 
the procedure for spline-wavelet decomposition of a 
document according to the third alternative 
implementation of the invention, specifically the wavelet 
packets technique. 

Figures 13a through I3e illustrate the operation of 
the process of Figures 12a and 12b on an array of 
coefficients. 

Figure 14 illustrates the operation of the process 
of Figures 12a and 12b in a tree diagram form. 

Figure 15 illustrates the organization of a data 
frame containing wavelet packet decomposition results and 
an associated header containing a decomposition tree map. 

Figure 16 illustrates a decomposition tree map 
according to the wavelet packet technique, illustrating 
the effects of pruning at certain component sequences. 

Figure 17 is a flow diagram illustrating the general 
procedure for spline -wavelet decomposition of a document 
according to the preferred embodiment of the invention. 

Figure 18 is an electrical diagram, in block form, 
of the spline -wavelet decompressor of the system of 
Figure l, according to the preferred embodiment of the * 
invention. 

Figure 19 is a flow diagram illustrating the 
procedure for spline -wavelet reconstruction of a document 
according to a first alternative implementation of the 
invention, specifically the dual-base technique. 
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Figure 20 is a flow diagram illustrating the 
procedure for spline -wavelet decomposition of a document 
according to a second alternative implementation of the 
invention, specifically the interpolatory wavelet 
5 technique . 

Figure 21 illustrates the reconstruction tree for 
spline -wavelet reconstruction of a generalized document 
according to the wavelet packets process. 

10 

Figure 22 is a flow diagram illustrating the 
procedure for spline -wavelet reconstruction of a document 
according to the wavelet packets technique. 

15 Figure 23 illustrates the operation of the process 

of Figure 22 in a tree diagram form, for an exemplary 
document . 

DETAILED D ESCRIPTION OF THE INVENTION 

20 

1 . Document communication and storage system with 
compression and decompression 

Referring now to Figure 1, a system for 
25 communicating or storing documents according to the 
preferred embodiment of the invention will now be 
generally described. The exemplary system shown in 
Figure 1 includes compression system 10 and decompression 
system 30 in communication with one another, such as via 
30 digital communication network 26. As such, this 

embodiment of the invention will be described with 
respect to these discrete compression and decompression 
locations; it is to be understood, of course, that the 
same physical computer or location may contain, or serve 
35 as, both compression system 10 and decompression system 
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30, particularly in the application of an archival system 
using the compression techniques to be described herein. 

In the embodiment of the invention illustrated in 
Figure 1, compression system 10 receives digital 
information representative of a document from image 
source 8. As noted hereinabove, the term "document" as 
used in this application refers to a two-dimensional 
representation or rendering of a nature that is 
conventionally made on a paper medium or on a graphics 
display by writing, printing, typing, drawing, operation 
of a computer-aided draw, paint or design program, or 
other similar conventional techniques, and those 
renderings that are commonly stored on paper, microfilm, 
microfiche, or electronically. As noted above, examples 
of such documents include text documents, bank checks and 
other banking transaction records, vital and legal 
records, maps, charts, printed works (including 
combinations of text and graphics), seismic plots, 
medical records, bank and insurance records, directories, 
identification images (pictures, signatures, etc.) and 
the like. As is well known to the public, examples of 
conventional electronic communication and storage of 
documents includes modern digital facsimile ("fax") 
equipment, CD-ROM storage and distribution of 
encyclopedias and other series of books, electronically 
or magnetically stored representations of transactions 
such as checks and other banking transactions and 
statements, and the like. As such, image source 8 may be 
implemented as a document scanner or a facsimile machine, 
in the case where the document is a paper or other hard 
copy representation. Alternatively, if the document is 
already in electronic form, image source 8 may be 
implemented as a computer system that receives the 
document from another electronic (or graphics) format or 
from another computer system over a communications 
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network, that retrieves the document from its own disk or 
tape storage, that receives the document directly via a 
fax modem, or that is used to generate the document 
itself. Of course, it should be apparent to those of 
5 ordinary skill in the art that other conventional image 
sources may alternatively serve as image source 8 in the 
system of Figure 1. 

The output of image source 8 is preferably a digital 

10 data stream representative of the appearance of the 

document, such as a bit map representation- Compression 
system 10 includes format converter 12 and spline-wavelet 
compressor 20. Format converter 12 receives the output 
of image source 8 (in the general case) and converts the 

15 digital representation received from image source 8 into 

a full ASCII binary bitmap representation suitable for 
compression by spline -wavelet compressor 20. According 
to the preferred embodiment of the invention, as will be 
described in detail hereinbelow, format converter 12 

20 converts the input document into a binary ASCII torm 

expressed in Portable Grey Level (PGM) format. Spline- 
wavelet compressor 20 performs a lossy compression of the 
input document, and formats the compressed document into 
the appropriate output format, in the manner described 

25 hereinbelow. 

The compressed representation of the input document 
may be communicated by spline-wavelet compressor 20 in 
compression system 10 over communications network 26 to a 

30 receiving computer or similar hardware receiving device 
including decompression system 30. Communication 
network 26 may be a conventional analog transmission or 
electronic digital communications network, or both an 
analog and digital network when including the appropriate 

35 clusters, analog- to-digital and digital-to-analog 

converters, and other necessary apparatus. Network 26 
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may be realized according to any conventional technology, 
including telephone line (including Tl, T2, and T3 
communication), hard-wired cable, fiber optic cable, 
broadcast or satellite transmission, and the like. 
Alternatively or in addition, the output of compressor 
system 10 may alternatively be presented to bus 25 for 
storage at main disk 22 (e.g., for archival storage), or 
to floppy disk 24 for off-line storage or for transmittal 
to another computer; of course, storage on other media 
such as tape and the like is also contemplated. 

Decompression system 30 according to the system of 
Figure 1 is operable to receive the compressed document 
data directly from compression system 10 over 
communications network 26, or via computer bus 27 from 
disk storage 22 or floppy disk 24. It will be apparent 
to those of ordinary skill in the art that the actual 
communication of the compressed representation of the 
document may, of course, be performed by way of a single 
transmission between compression system 10 and 
decompression system 30, or alternatively by way of a 
broadcast transmission by compression system 10 to 
multiple decompression systems 30. 

Many other types of transmissions are, of course, 
also contemplated. For example, compression system 10 
may store the compressed document onto archival disk 
storage 22, for example at a central server unit or , 
location, such as a bank, library, central company 
office, or document service. In this case, many 
documents will be compressed and stored for later 
communication. Decompression system 3 0 may then call 
this central location to access one or more documents, in 
which case the central location will retrieve the 
appropriate compressed documents from its main disk 22 
and communicate the same to decompression system 30 over 
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communications network 26. Further in the alternative, a 
remote computer may request certain documents, in 
compressed form, from a central storage location; after 
receipt of the compressed documents via communications 
5 network 26 or by transport of the compressed documents on 
portable floppy disk 24, the remote requesting computer 
may not immediately forward the compressed documents to 
decompression system 30, but instead store the documents, 
in compressed form, in its main disk 22. Decompression 
10 system 30 will then receive the compressed documents via 
its computer bus 27 for decompression as desired. 

It is therefore contemplated that the system of 
Figure 1 may be implemented or operated in these and 

15 other similar ways within the scope of the present 
invention, in the fields of data and record 
communication, record archival and retrieval, catalog 
services, and the like. In addition, it is contemplated 
that the system of Figure 1 will also be useful in 

20 providing services such as on-demand video images in the 
nature of "picture book" services, the transmission of 
still images such as useful with video telephonic 
equipment, identification systems in which pictures and 
signature images are communicated, and the like. 

25 

In any case, decompression system 30 includes 
spline-wavelet decompressor 40 and format converter 32. 
Spline-wavelet decompressor 40 receives the compressed 
document data, and performs substantially the reverse of 

30 the process performed by spline -wavelet compressor 20 in 

compressor 10. The output, of spline -wavelet decompressor 
40, according to this preferred embodiment of the 
invention, will be a PGM format representation of the 
compressed document. As will be described hereinbelow, 

35 since the compression technique according to the present 

invention is of the lossy type, the output of 
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decompressor 40 in decompression system 30 may not be 
identical to the input to compressor 20 in compression 
system 10. The output of spline -wave let decompressor 40 
is presented to format converter 32, which reformats the 
decompressed document into the suitable form for display 
on video display 34d, for printing by printer 34p, or for 
output by way of another conventional output device. 



2^ The com pression system 

The construction and operation of compression system 
10 according to the preferred embodiment of the invention 
will now be generally described. Compression system 10 
may be a stand-alone system, for example as a special 
archiving machine dedicated for document scanning and 
storing, or can be arranged so as to be an add-on card 
for a conventional high performance personal computer or 
workstation; of course, compression system 10 may also be 
implemented as a function of a larger computer, such as a 
mainframe computer or supercomputer. As illustrated in 
Figure 2, the compression process begins with process 42, 
in which format converter 12 receives a digital bit 
stream representative of the input document from image 
source 8. The format of the digital bit stream 
representative of the document, as produced by image 
source 8 and presented to format converter 12., may be any 
one of the known formats such as PCX, IMG, GIF, TIF, RLE, 
NTSC, PAL, and the like. Compression system 10 according 
to this embodiment of the invention is able to compress 
input documents of various types, not only monochromatic 
(two-color) documents, but also documents that are in 
full color or in a grey-scale form. Format converter 12, 
as noted above, receives this bit stream from image 
source 8 and converts it to a binary PGM format, as will 
now be described in detail. 
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a. Format conversion 

Upon receipt of the digital document in process 42, 
5 format converter 12 performs process 44 of Figure 2, in 
which the digitally- represented received document is 
transformed into a byte-packed PGM format for compression 
by spline -wavelet compressor 20. 

10 Referring now to Figure 3a, the construction of 

format converter 12 will now be described in detail. As 
shown in Figure 3a # format converter 12 according to this 
embodiment of the invention includes format decoder and 
color expansion device 14, which has an input for 

15 receiving the input data stream from image source 8. 
Format converter and color expansion device 14 is 
preferably implemented in the conventional manner for 
performing the decoding and expansion operations 
described hereinbelow. For example, circuitry for 

20 performing such format decoding is well known in the art, 
such as described in Rimmer, Supercharged B itmapped 
Graphics (Windcrest/McGraw Hill 1992); conventional 
circuitry for performing such color expansion is also 
readily available, and includes such devices as color 

25 palette tables in RAM, ROM or in other electronic storage 
devices . 

The output of format converter and color expansion 
device 14 is forwarded to bit determination device 15, 
and also to symbolic substitution circuitry 16, to which 
the output of bit determination device 15 is also 
presented. Symbolic substitution circuitry 16 presents 
its output to byte packer 18, which completes the format 
conversion as necessary prior to the compression 
operation according to this embodiment of the invention, 
for presentation to spline-wavelet compressor 20. Each 



30 



35 



WO 96/09718 



PCTYUS95/12030 



19 



of bit determination device 15, symbolic substitution 
circuitry 16, and byte packer 18 may be constructed 
according to conventional circuitry for performing these 
operations, or alternatively may be performed by a single 
high performance graphics or general purpose processor, 
as desired. 

Referring now to Figures 3b and 3c, the operation of 
format converter 12 in performing transformation process 
44 will now be described in detail. Figures 3b and 3c 
represent manual and automatic modes of transformation 
process 44, respectively. 

Referring first to Figure 3b, relative to the manual 
mode of transformation process 44, transformation process 
44 begins with process 39, in which format converter 12 
receives a user input regarding the number of bits by 
which each pixel of the document or image is to be 
represented. In process 41, format decoder and color 
expansion device 14 decodes the data from the format 
presented by image source 8, such format being PCX, IMG, 
TIF, GIF, RLE, YUV, etc., into a color matrix, or color 
palette table, representation of the image signal. It is 
preferred that format decoder and color expansion device 
14 also be able to detect the type of document to which 
the input bit stream corresponds, to provide flexibility 
in the types of documents presented to compression system 
10. In the case of color input documents, format decoder 
and color expansion device 14 may thus also, in process 
41, perform a color expansion operation so that the 
output from device 14 is in an expanded RGB format, with 
each pixel represented by red, green and blue color 
component bytes. 

Format decoder and color expansion device 14 
preferably also includes sufficient logic to perform 
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decision 43 (of Figure 3b) , in which the determination is 
made as to whether the input document is a "satisfied" 
document, that is whether the number of bits representing 
each pixel in the input document is less than or equal to 
the number of bits specified in process 39. For example, 
in the case of color documents, the output of format 
decoder and color expansion device 21, after the color 
expansion operation, may correspond to digital values in 
an RGB format, where each color component is represented 
by a multiple -bit value indicative of the intensity of 
that color. Similarly, each pixel in a representation of 
a grey-scale document will have a single color multiple - 
bit component corresponding to the intensity of the 
brightness (in a black and white system) for that pixel, 
while a representation of a two-color (e.g., black and 
white) , or binary, document requires only a single bit 
per pixel. If decision 43 determines that the output of 
format decoder and color expansion device 14 satisfied 
the user specification, control passes to process 47, 
which is described hereinbelow. 

However, if decision 43 determines that the input 
document does not satisfy the user specification (i.e., 
the number of bits per pixel in the input document 
exceeds the number of bits specified by the user in 
process 39) , the output of format decoder and color 
expansion device 14 is forwarded to bit determination 
device 15, to perform the desired dithering process 
necessary to convert the digital representation ot the 
document to the exact bit representation. As is well- 
known in the art, for example, the process of dithering 
corresponds to displaying a grey color in a monochrome 
representation where the shade of grey depends upon the 
relative density of black and white pixels for the 
corresponding portion of the image. The Rimmer reference 
cited hereinabove also provides a description of 
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conventional dithering techniques. It is contemplated 
that conventional circuitry may be used for bit 
determination device 15, including conventional graphics 
processing circuitry. 

According to the preferred embodiment of the 
invention, bit determination device IS is controllable so 
as to operate according to one of several dithering 
modes. For example, in the case where bit determination 
device 15 is implemented as a programmable graphics 
processor, it is contemplated that bit determination 
device 15 may include program code corresponding to each 
of several dithering routines, selectable by way of a 
pointer or the like. For example. Table 1 hereinbelow 
illustrates the correspondence between a dithering mode 
code and the selected dithering method, according to this 
embodiment of the invention: 



Table 1 

Dithering M ? fh^H 
Bayer-Dickering Method 
Floyd- Steinberg Method 
Burke's Method 
Stucki Method 
Dithering disabled 

As a result of dithering process 45, or 
alternatively if the output of format decoder and color 
expansion device 14 already corresponds to a proper color 
representation (as determined by process 43) , the 
symbolic substitution process 46 and byte packing process 
47 described hereinbelow for the binary and non-binary 
documents, as the case may be, is then performed. 



Dithering Mode CnAf? 
1 
2 
3 
4 
0 
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Referring now to Figure 3c, the automatic mode of 
format conversion process 44 ' will now be described in 
detail. Process 44' begins with color expansion of the 
document in process 41, as before. The hardware 
5 construction of format converter 12 for this embodiment 
of process 44' will be similar as that shown in Figure 
3a, and as such no additional description of the 
circuitry will be provided herein. For non-two-color 
{i.e., color or gray-scale) documents, the output of 

10 color expansion process 41 will be an image table with at 

least one byte of data per pixel. Following color 
expansion process 41, process 49 is performed in this 
automatic mode to determine the number of colors 
necessary to represent the document is selected. Process 

15 4 9 may be done by way of a color histogram statistic 

method, in which the number of colors necessary to 
represent the document is selected by determining the 
frequency of true colors in the document and by 
determining how many are reasonably necessary to capture 

20 the bulk of the information. Process 49 thus results in 
each byte (or larger word) for each pixel containing one 
of a fixed set of values, representative of a reduced 
number of colors, associated with that pixel. Process 49 
may alternatively be performed by way of a selected 

25 dithering technique, to represent the image by a reduced 

number of colors. In either event, the image table after 
process 49 will be a representation of the image by a 
reduced number of colors, represented by a reduced set of 
values (a, b, c, . . . ) . 

30 

Whether produced by the manual or automatic format 
conversion processes 44, 44' described hereinabove, the 
result will be an image table having a digital 
representation of intensity or color for each pixel. 
35 Symbolic substitution process 46 and byte -packing process 
4 7 are then performed on this image table, as shown both 
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in Figures 3b and 3c. However, symbolic substitution 
process 46 and byte -packing process 47 will differ for 
binary document than for multi-color documents, as will 
be described hereinbelow. 



1* Symbolic substit ution and bvte-packinq for 

binary flocvimgrrts 

In the case of a binary document (i.e., a two-color, 
black and white, document), the document is represented 
as an image matrix or table containing two values a, b, 
corresponding to black and white, respectively. For 
example, in the case where each pixel in the document is 
represented by an eight -bit value, the value "0" may 
represent black and the value B 255 10 " may represent white; 
of course, the dithering process may assign different 
numerical values to the two colors represented. Symbolic 
substitution process 46, performed by symbolic 
substitution circuitry 16 of format converter 12, is 
operable to detect the two values a,b in the image table, 
and to substitute the binary values 0,1 therefor, 
respectively. 

For example, in the case of an eight -by-eight image 
table, the output from bit determination device 15 (or, 
if appropriate, directly from format decode and color 
expansion device 14), may appear as follows: 
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a 


b 


a 


a 


a 


b 


b 


b 


b 


a 


a 


b 


b 


a 


a 


b 


a 


a 


a 


a 


b 


a 


b 


a 


b 


b 


a - 


b 


'a 


b 


b 


a 


a 


a 


a 


b 


b 


a 


a 


b 


b 


a 


b 


a 


a 


a 


b 


a 


a 


a 


b 


b 


a 


b 


a 


a 


b 


b 


a 


a 


b 


a 


b 


b 



In the case where each pixel is represented by an byte, 
and where the two color codes a, b correspond to 0, 255, 
respectively, this image table would appear as follows: 



0 


255 


0 


0 


0 


255 


255 


255 


255 


0 


0 


255 


255 


0 


0 


255 


0 


0 


0 


0 


255 


0 


255 


0 


255 


255 


0 


255 


0 


255 


255 


0 


0 


0 


0 


255 


255 


0 


0 


25b 


255 


0 


255 


0 


0 


0 


255 


0 


0 


0 


255 


255 


0 


255 


0 


0 


255 


255 


0 


0 


255 


0 


255 


255 



After symbolic substitution process 27, this image 
table would appear as follows : 



0 


1 


0 


0 


0 


1 


i 


1 


1 


0 


0 


1 


1 


0 


0 


1 


0 


0 


0 


0 


1 


0 


1 


0 


1 


1 


0 


1 


0 


1 


■ 1 


0 


0 


0 


0 


1 


1 


0 


0 


1 


1 


0 


1 


0 


0 


0 


1 


0 


0 


0 


1 


1 


0 


1 


0 


0 


1 


1 


0 


0 


1 


0 


1 


1 



Of course, if the two color codes a, b from bit 
determination device 15, or from format converter and 
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color expansion device 14, were already 0, l, 
respectively, symbolic substitution process 46 would be 
unnecessary. 

For this example of a binary document, once the 
image table for the document is converted to binary 
values, byte packing circuitry 18 performs byte packing 
process 47 to place the document into a PGM format. Byte 
packing process 47 converts each eight binary bits in the 
image table, representative of eight adjacent pixels in 
the document, into an eight-bit word (byte) for 
subsequent numerical processing. Process 47 thus assigns 
binary powers to each of the pixel locations in an eight - 
pixel group; for example, the left -most pixel may be 
assigned the power 2 7 and the right -most pixel in the 
group may be assigned the power 2°, with the pixels in 
between corresponding to the intermediate powers in 
order. The resultant byte-packed representation of the 
eight -bit pixel groups then corresponds to the sum of the 
values in each pixel location (l or 0) times the assigned 
power of two for that location. The exemplary eight-by- 
eight image table noted above would appear, after byte- 
packing in the horizontal direction, as follows (all 
numbers decimal) : 



71 
153 

10 
214 

25 
162 

52 
203 



Of course, horizontally adjacent eight -pixel groups in a 
larger document would have their own byte-packed values. 
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If the horizontal size of the document is not a multiple 
of eight, the remainder bits are "zero-packed". For 
example, if the horizontal size of the input document is 
70 pixels, two zeroes may be added at the end of. the 
5 pixel string prior to the byte-packing process; since the 
actual size of the document is known, such zero-packing 
will not result in any error or confusion. Byte-packing 
process 47 thus reduces the storage capacity necessary 
for representation of a two-color document significantly; 

10 for example, where the two-color image table represents 

each pixel with a byte, byte packing process compresses 
the image table by a factor of eight. The result of byte 
packing process 47 thus resembles an eight -bit PGM 
format, which is particularly convenient for processing 

15 by microprocessors or computers using ASCII coding and 

programming environments, as the fundamental storage unit 
is the byte in these environments . 



20 ii . Symbolic Substitution and bvte-packina for 

non-binarv documents 

While the foregoing description of byte -packing 
according to the present invention was directed to binary 

25 (i.e., two-color) documents, it is of course well known 

that a wide range of documents are not of two-color type, 
and thus cannot be represented in binary form without the 
loss of information. For example, conversion of color 
and gray-scale documents into binary form will 

30 necessarily cause the loss of the color and gray-scale 

information, respectively. In addition, even if the 
original input document is a two-color document, 
practical limitations in the scanning or digitization 
hardware used to convert the document into machine - 

35 readable form may result in a digital representation that 

may not be two-color in the strictest sense, in which 
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case restriction of the output into binary form will also 
cause the loss of information. These effect limit not 
only documents that are fully in graphics form, but also 
the graphic portion of documents containing both text and 
graphics . 



It is therefore useful to digitally represent these 
documents with more than a single bit, for example with 
two, three, four or more bits, depending upon the range 
of "color" information to be considered in the process. 
As is fundamental in the art, to digitally represent n 
colors in a document, 2" bits of information are required 
for each pixel; for example, an image having up to 
sixteen colors requires four bits per pixel in its 
digital representation, and an image allowing up to eight 
colors requires three bits per pixel. However, as in the 
case hereinabove for the two-color document, an entire 
byte is generally used for the representation of each 
pixel, even though only eight colors are necessary. 
Symbolic substitution and byte packing according to this 
embodiment of the invention will be able to save 
significant memory space, thus providing a significant 
degree of lossless compression. 

For example, a document may be represented by eight 
colors per pixel as a result of decision 43 or process 45 
in the manual format conversion mode, or of process 49 in 
the automatic format conversion mode, whether 
corresponding exactly to the input document, generated by 
color histogram statistics or generated by dithering. In 
this example, the eight colors are represented by an 
eight bit value (i.e., ranging from 0 to 255 XB ) , and 
consist of the set (0, 24, 53, 75, 103, 148, 196, 255); 
in hexadecimal notation, this set would be (00, 18, 35, 
4B, 67, 94, C4, FF) . An example of an image table for an 
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eight color document of a size eight pixels by eight 
pixels is as follows: 



53 


196 


148 


103 


24 


24 


75 


53 


255 


196 


196 


103 


53 


24 


255 


103 


148 


196 


75 


53 


24 


24 


0 


0 


75 


53 


53 


255 


103 


148 


0 


24 


75 


53 


255 


24 


0 


148 


148 


103 


196 


148 


24 


24 


0 


196 


53 


53 


24 


255 


53 


196 


75 


148 


103 


0 


24 


255 


196 


196 


255 


75 


53 


75 



Process 46 is then performed in which a symbolic 
15 substitution is performed such that each of the reduced 
number of colors is represented by the smallest (in 
number of bits) word size. For example, if the result of 
process 49 is a set of eight color values over the range 
from 0 to 255 10 , the symbolic substitution of process 46 
20 represents these eight values by the eight binary values 
0 through 11 1 2 , stored in each byte (or larger word) 
associated with each pixel. For the exemplary image 
table shown above, the symbolic substitution of process 
46 would perform the following substitution: 

25 

8 -bit Value (hexadecimal) Substituted Value 



00 


00 


18 


01 


35 


02 


4B 


03 


67 


04 


94 


05 


C4 


Ufa 


FF 


07 



35 



WO 96/09718 



29 



PCT/US95/120S0 



The resultant exemplary image table, after the symbolic 
substitution of process 46, would appear, ■ in hexadecimal 
form, as follows: 



02 


06 


05 


04 


01 


01 


03 


02 


07 


06 


06 


04 


02 


01 


07 


04 


OS 


06 


03 


02 


01 


01 


00 


00 


03 


02 


02 


07 


04 


05 


00 


01 


03 


02 


07 


01 


00 


05 


05 


04 


06 


05 


01 


01 


00 


06 


02 


02 


01 


07 


02 


06 


03 


05 


04 


00 


01 


07 


06 


06 


07 


03 


02 


03 



As indicated by the above table, after the symbolic 
substitution of process 46, each pixel is still 
represented as a full byte. 

It has been found, according to this embodiment of 
the invention, that byte packing can be done in such a 
manner as to ignore pixel boundaries, such that the color 
information for a pixel may be partially contained in one 
of the packed bytes and partially contained in the next 
packed byte in sequence. After the symbolic substitution 
of process 46, byte packing process 4 7 according to this 
embodiment of the invention is then performed to reduce 
the number of bits required to store the image table to 
the minimum required. 

For the example described hereinabove, it is seen 
that a full byte is used to represent eight possible 
values, which at most require three bits; the preceding 
table thus includes five unnecessary bits for each pixel. 
Process 47 thus may be considered to include the 
operation of discarding the excess bits, such that only 
three bits per pixel (in this example) are used. The 
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exemplary image table may thus be expressed, in binary 
form, as follows: 



010 


110 


101 


100 


001 


001 


Oil 


010 


111 


110 


110 


100 


010 


001 


111 


100 


101 


110 


011 


010 


001 


001 


000 


000 


Oil 


010 


010 


111 


100 


101 


000 


001 


Oil 


010 


111 


001 


000 


101 


101 


100 


110 


101 


001 


001 


000 


110 


010 


010 


001 


111 


010 


110 


011 


101 


100 


000 


001 


111 


110 


110 


111 


Oil 


010 


Oil 



According to this embodiment of the invention, this 
image table may be packed into eight -bit bytes by 

15 regrouping the bits in this table into groups of eight, 

rather than into groups of three as used to represent the 
eight colors of the image. This regrouping of the 
digital information without regard to pixel boundaries is 
made possible by the subsequent spline -wavelet 

20 operations, in which the image data is transformed; as 
such, it has been discovered that pixel boundaries need 
not be maintained in the byte-packing process. Of 
course, if the number of colors of the document is such 
that the number of bits per pixel evenly divides into 

25 eight (i.e., one, two or four), the pixel boundaries will 
match up with the byte boundaries. 

With reference to the eight -color example above, 
byte packing by process 47 will produce an image table in 

30 which the first byte in each row will contain the first 
two pixels plus the two most significant bits of the 
third pixel; the second byte will contain the least 
significant bit of the third pixel, the fourth and fifth 
pixels, and the most significant bit of the sixth pixel; 

35 and the third byte will contain the two least significant 

bits of the sixth pixel, and the seventh and eighth 
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pixels. In general, additional zero bits may be added in 
order to arrive at full bytes, depending upon the number 
of pixels in the image. The exemplary image table noted 
above will appear as follows upon completion of byte 
packing operation 46': 



01011010 


11000010 


01011010 


11111011 


01000100 


01111100 


10111001 


10100010 


01000000 


01101001 


01111001 


01000001 


011O1011 


10010001 


01101100 


11010100 


10010001 


10010010 


00111101 


01100111 


01100000 


00111111 


01101110 


11010011 



Represented in hexadecimal notation, the image table 
would be represented as: 



5A 


C2 


5A 


FB 


44 


7C 


B9 


A2 


40 


€9 


79 


41 


6B 


91 


6C 


D4 


91 


92 


3D 


67 


60 


3F 


6E 


D3 



in this example, therefore, process 44' has compressed 
the sixty- four original bytes into twenty- four bytes, , 
providing a compression ratio of 2.667 prior to 
decomposition. The compression ratio obtained by process 
44' according to this embodiment of the invention will, 
of course, increase to the extent that fewer colors are 
necessary for the representation of the image; of course, 
the resultant image will be nearer the input document as' 
more colors are allowed. 
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Upon completion of byte-packing process 47 (or 47', 
as the case may be), transformation process 44 (or 44') 
of Figure 2 is thus completed, with the results forwarded 
by format converter 12 to spline-wavelet compressor 20 in 
5 PGM format which, as will be seen, is quite convenient 

for the compression operations to be described below. In 
addition, as is evident from the foregoing description, 
format converter 12 according to this embodiment of the 
invention is operable to convert a wide range of input 

10 document formats, including full color or gray scale 

representations, into a PGM format, with a significant 
amount of compression already achieved. For example, a 
1024 -by- 1024 (pixels) image table reduces to a 128-by- 
1024 table for compression by spline-wavelet compressor 

15 20. 

b. Spline -wave let compression 

20 Referring back to Figure 2, following completion of 

transformation process 44, spline-wavelet compressor 20 
performs process 48, in which the byte-packed PGM format 
representation of the input document is decomposed; 
decomposition of the image information is an integral 

25 part of the compression of the document for transmission 
or storage. According to the present invention, the 
decomposition of process 48 may be performed according to 
one of three processes 48a, 48b, 48c (collectively 
referred to as process 48) utilizing spline- wavelet 

30 decomposition, each of which will be described in detail 

hereinbelow. As will become apparent, these alternative 
spline -wavelet decomposition processes 48 allow selection 
of the appropriate compression technique depending upon 
the performance of the compression and decompression 

35 systems, the desired compression ratio, the desired 

compression or decompression speed, and other parameters. 
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According to the preferred embodiment of the invention, 
compression system 20 is multiply programmed so that the 
user may select the specific decomposition one of 
processes 48a, 48b, 48c. 

In the general sense, decomposition process 48 is 
followed by quantization of the wavelet components of the 
decomposed image signal, in process 50; this quantization 
enables compression of the storage requirements for the 
input document, by eliminating from the information those 
components of the decomposed image that are unimportant 
to the image (as determined by the decomposition 
process) . Decision 51 is then performed by compression 
system 20 to determine if the compression ratio after 
quantization process 50 is acceptable; if not, 
decomposition process 48, for additional levels, and 
quantization process 50 are again performed to further 
compress the image information. Upon the desired 
compression ratio being reached (as determined by 
decision 53), lossless compression may be performed by 
compression system 20 in process 52 according to 
conventional techniques, following which compression 
system 20, in process 54, formats the compressed image 
information into the format appropriate for communication 
over digital network 26 or for archival storage by way of 
disk storage 22, 24. 



Construction of spline -wavelet compressor 

Referring now to Figure 4, the construction of 
spline-wavelet compressor 20 according to the preferred 
embodiment of the invention will now be described in 
detail. Spline-wavelet compressor 20 includes data 
controller 56, which receives the PGM formatted image 
information from format converter 12 and which also, 



WO 96/09718 



PCT/US95/12050 



34 



according to this example, controls the operation of the 
other components within spline -wavelet compressor 20. in 
this example, data controller 56 presents and receives 
signals on control bus 63 to control the timing, feedback 
5 and transmission of information through and from spline - 
wavelet compressor 20, including the case where data 
received from format converter 12 is transmitted directly 
through spline-wavelet compressor 20 without compression. 
Data controller 56 is also preferably able to detect the 

10 presence of input data presented by format converter 12, 
and to detect the format or type of data so presented. 
In addition, data controller 56 also preferably receives 
control signals, for example from the computer into which 
compression system 10 is installed as an add-on function; 

15 these control signals may indicate the type of 

compression desired, the type of quantization to be 
performed, and the selection of other options available 
in the compression process, as will be described in 
detail hereinbelow. It is therefore contemplated that 

20 data controller 56 may be implemented as a relatively 

simple logic circuit, for example as implemented into a 
gate-array or other semi-custom logic circuit, for 
performing these functions. 

25 In this embodiment of the invention, data controller 

56 forwards the input data that it receives from format 
converter 12 to digital signal processor (DSP) 60 by way 
of data bus 58. DSP 60, as will be described in further 
detail hereinbelow, is the main processing unit for 

30 performing spline-wavelet decomposition process 48 

(Figure 2) . Examples of a readily available digital 
signal processor suitable for use as DSP 60 according to 
this embodiment of the invention are the TMS320C25 and 
TMS320C30 digital signal processors manufactured and sold 

35 by Texas Instruments Incorporated; of course, other 
digital signal processors and microprocessors may 
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alternatively be used to perform the spline -wavelet 
decomposition operations described hereinbelow. DSP 60 
is coupled to data bus 61d and address bus 61a 
(collectively referred to as memory bus 61) for 
communication with program memory 65 and image memory 67. 
According to this embodiment of the invention, DSP 60 is 
programmed (by way of code stored within DSP 60 and also 
in program memory 65) to perform decomposition of the 
data in PGM format presented to it by data controller 56 
on bus 58 according to pre -calculated decomposition 
coefficients stored in program memory 65. The image data 
is stored in image memory 67 before, during and after the 
decomposition; in this example, image memory 67 is 
arranged in four banks, totaling two megabytes in 
capacity. DSP 60 is also connected to control bus 63, so 
that it may be controlled by data controller 56 and so 
that it can effect the necessary control of other 
components in spline-wavelet compressor 20, including 
memory 65, 67, during the performance of decomposition 
process 48, described in further detail hereinbelow. 

As noted above, according to this embodiment of the 
invention, spline-wavelet decomposition process 48 may be 
performed by DSP 60 according to one of several optional 
decomposition or compression modes, controlled by data 
controller 56. These modes may be selected by a code 
communicated by data controller 56 to DSP 60 over control 
bus 63, an example of which is as follows: 



0 
1 
2 
3 

4-7 



No compression 

Dual base wavelet decomposition 
interpolatory wavelet decomposition 
Wavelet packet decomposition 
Reserved 
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Each of the three decomposition techniques, and the 
resulting compression of the input document, will be 
described in detail hereinbelow. 

5 DSP 60 is also bidirectionally coupled to 

quantization processor 62, to which DSP 60 forwards the 
results of the decomposition process. Quantization 
processor 62 quantizes the decomposed information 
(process 50 of Figure 2) and forwards the same to 

10 lossless compressor 64 or back to DSP 60, depending upon 

the results of decision 51 in determining whether the 
desired compression ratio has been reached. The details 
of quantization process 50 will be described in further 
detail hereinbelow. According to this embodiment of the 

15 invention, quantization processor 62 is preferably 

implemented as a programmable microprocessor or custom 
logic circuit for performing the functions described 
hereinbelow; such implementation is believed to be 
readily apparent to one of ordinary skill in the art 

20 having reference to this description. 

Quantization process 50 may be performed by 
quantization processor 62 according to one of various 
selectable conventional quantization modes, under the 

25 control of data controller 56 via control bus. 63. These 
modes may be communicated to a three-bit quantization 
mode register within quantization processor 62, which 
controls the type of quantization to be performed. An 
example of the quantization codes and their corresponding 

30 quantization modes are as follows: 
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0 

1 

2 

3 

4 

5-7 



No quantization 
thresholding 
scalar quantization 

'PEG quantisation (i.e., using tables) 
Federal Bureau of Investigation 
quantization standard for fingerprints 
reserved for other quantization modes 
(e.g., vector quantization) 

Upon completion of quantization process 50 and * 

51 indicating that t-h. * • ^ocess 50, and decision 

reached. ^Jtx.ation n ""o has been 

, quantization processor 62 present- «= -i«-o 

to lossless compressor 64 for IcJl! reSUltS 
process 62. lossless compression 



™S3 2 0«0 or B.S320C30 ^T^": " 
incorporated, the isso »^ In "™**ts 
Corporation, or general ^ 3Vailible ^ 
the ,0336 and aof^aUabL " T""" " 
the 6,030 and 68040 avaul. f Coi *°«"°n « 

in such a manner as to perloLT" T^' ' 
process 52 upon the £tT fr " COnpreSsi ° a 

t^o.i from quantization processor « 

Lossless compression process s3 „, u Processor 62. 

lossless r™» Process 62 may be performed by 

lossless compressor 64 according to the desir.d 
conventional technique, such as Huffm™ T 

providing this function. circuit for 

compre^ed 0 ^: "n aMtT " * 

to data a» L tert c T^'T ' "* 18 ^""^ 

provides an interface be tB een s Dl " " 

ce Between spline-wavelet compressor 
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20 and network 26 or bus 25, and as such must arrange the 
bitstream output from lossless compressor 64 and arrange 
the same into a suitable format for transmission. Data 
flow interface 66 also provides a feedback signal to data 
controller 56 upon transmission of a frame of compressed 
data, based upon which data controller 56 may commence 
the processing of the next image to be compressed. 



SPline-waveiPi- h ^coibpoiH < n r 



As noted above, according to this embodiment ot the 
invention, spline-wavelet compressor 20 is operable to 
perform decomposition process 48 according to any one of 
three types of variations on a general spline -wavelet 
decomposition algorithms, namely dual-base wavelets, 
interpolator wavelets, and wavelet packets. As each of 
the variations have different advantages relative to the 
others, the selection of a variation will depend upon the 
particular compression parameters for the input document 
to be compressed, and also will depend upon the 
decompression application (i.e., communication, archive 
retrieval, etc.). m summary, it is contemplated that 
dual-base wavelet decomposition will provide reasonable 
quality at reasonable computational speed, and as such 
will be useful as a default decomposition mode, it is 
contemplated that interpolator wavelet decomposition 
will provide higher computational speed at a cost of 
reduced image reproduction quality, while wavelet packet 
decomposition will provide high quality and high 
compression ratio at a cost of slower execution speed. 

Two of these three approaches, specifically the 
dual -base wavelets and interpolatory wavelets, utilize 
half-tree decomposition and reconstruction, while the 
wavelet packet approach utilizes full-tree decomposition. 
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z:z*z 0 : zzit description ° f 
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one may project th^ 3 WaVelet £unCtlon 

sequence of scaLna f ^ ^«ion f„> as , 

scaling ft-ctUn^^^? * W ' 

a sequence of scali^f ' " ' ""^ be """"^ed with 

projected scaling function corttt^'.^FT'" 9 

coefficients (b.) provides a band sTs' f dM °'" posi "° n 
decomposing the projected sea, ? rMUlt ' 
coefficients (c •] i„ c ! ! , * fUnC "° n W"«i™ation 
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sequence {c n 0 } with decomposition sequences {a,,}, {b n } 
produces low-pass component approximation coefficient 
sequence {c,,- 1 } and band-pass component approximation 
coefficient sequence {d," 1 }. Decomposition of low-pass 
spline approximation coefficient sequence {c,,* 1 } with 
decomposition sequences {aj, {b n } produces second-level 
low-pass and band-pass approximation coefficient 
sequences {c»- 2 }, {dV 2 }, respectively. 

For the two level case of Figure 5a, the input 
signal function f (x) can be represented by the 
approximation coefficient sequences {c n " 2 }, {d,,* 1 }, and {cV 
a }, assuming that one may reconstruct sequence {c n - x } from 
sequences {c n ' 2 } and {<V 3 }. Level -by- level reconstruction 
is illustrated in Figure Sb for this two- level case, 
beginning with the reconstruction of low pass component 
sequence {c^} from sequences {c„- 2 }, {dV 2 } by convolution 
of the approximation coefficient sequences with 
reconstruction sequences { Plt }, {qj, respectively, and 
summing of the results. The next level involves the 
reconstruction of {c n °}, by convolution of approximation 
sequence components {c„-*}, {^) again with reconstruction 
sequences {p k }, {qj, respectively, followed by summing of 
the results to arrive at approximation coefficient 
sequence {c n 0 }. 

The efficiency and performance of any procedure for 
performing this decomposition and reconstruction, both 
for the methods according to the present invention and, 
in general, for all wavelet-based algorithms, depends 
upon the length and data type (i.e., integer, floating 
point, rational, irrational) of the decomposition 
sequences {a n }, {b n } and the reconstruction sequences 
{Pkh {qie}- The values contained within these sequences 
depend primarily on the wavelet selected for use in the 
decomposition. In many cases, particularly those in the 
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i^fLT T thus requlre "—"on. and result 

in inefficient and inaccura^ ~ ^ . 

in convention.! d^^LnST' 10 " 

processing equipment. 

According to the preferred embodiment of the 
mention, the wavelet function selected for use in the 
deco^osition i s the compact* supported linear blc^ 
spUne waveiet or -boundary spline-wavelet" described^ 
Chux and Sua*. .„ avelecs on . Bounded lnterv ^" lbed » 

ST" ^^ro,i m i rin nTl llll l , V01UM s (Dec 



<P2\X1 - 2-X x in fl>2 , 

otherwise 



n~ X in [1 ' 2) (l) 



Figure 6 graphically illustrates scaling function * ,,, 

including the JL tta ^ JTj^TE^ 
and reconstruction, may be done effectively, 
furthermore it has been found that the linear B-spline 
satisfies the two-scale relation: 



*2 -2> a * a (2*-*) 

*«0 



where 



(2) 
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Pjt=2 ""1jt) 



(3) 



For the case where m = 2, and k = {0, 1, 2 ), p k - 2f 

1 ) . 

For one-dimensional space, the linear spline wavelet 
function * 2 (x) may be explicitly expressed 



as: 



where : 

ft-(-U*2-»g(J)* 4 (J:*l-i).Jfc-o,l 4 



(4) 



(5) 



The expression for the linear spline wavelet fc( X ) is in 
terms of the scaling function * 2 <x), which allows for 
relatively easy evaluation. These two scale relations of 
the linear B-spline and wavelets also provide a basis for 
general multiresolution analysis, which is utilized 
according to the preferred embodiment of the invention. 

As is known in the art, any cardinal B-spline 
generates a multi-resolution analysis (mra) . 
Specifically, the collection of integer translates of a 
cardinal B-spline scaling function <f> constitutes an 
approximation space V 0 , using, for each integer j, the 
notation : 
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k *' 



(6) 



and the notation *(x) = n b (x), for the m" B-spline 
(usually with . - 2 , . For the scal . ng funct 

JoalT 3 mUlti - reSOlution —lysis, the approximation 
spaces are related as follows: 



V. 2 c v. a c v„ c v a c V 2 . 



For each 3 , since v, c V^, there is a unique subspace W 
« V W which is the orthogonal cogent If v a . This 
subspace Wj is called the wavelet subspace of v 
represented by the notation: 



(7) 



The approximation space V 0 is generated by the integer 
translates of scaling function 4 , more generally theV 
approbation space Vj is generated by W , . sim 
the wavelet subspace Wj is generated by W translates of 
a spline-wavelet * B ( X ), namely.- 



w = 



k 



(8) 



Based upon the foregoing, according to the preferred 
embodiment of the invention, decomposition process 48 
wall now be generally described relative to Figure 6- 
note that certain options in the particular spline and 
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wavelet functions will be described in further detail 
hereinbelow. Process 48 begins with the projection of 
the input signal function f (x) into spline space, in 
process 68. In this example, it is preferred from the 
standpoint of computational simplicity to use the linear 
B-spline-wavelets, although higher order spline-wavelets 
may alternatively be used; it should be noted, however, 
that odd ordered spline-wavelets (i.e., linear, cubic, 
etc.) are preferably used according to the present 
invention. 

According to the foregoing notation, the projection, 
or mapping, of the one -dimensional input function f (x) 
into spline space corresponds to the operation f (x) e V„. 
In the one -dimensional linear case, the input signal 
function f (x) maps to the function f 0 (x) in spline space 
V 0 , which may be represented as follows: 



f 0 U) 

(9) 

where k corresponds to the number of input signal samples 
over a selected interval, in the linear spline space V 0 , 
the signal function f 0 (x) may be represented by the spline 
coefficients {c k 0 } . In the case of the linear B-spline, 
it is apparent that 

f 0 (k) = c k ° do) 

giving rise to the properties that (i) the approximation 
coefficient sequence {c k 0 } is exactly the original 
sequence of input signal samples, and (ii) the function 
f 0 (x) is exactly represented as the joining line segments 
between the input signal sample points. 
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Of course, the documents upon which the present 
invention is intended to operate are two-dimensional in 
nature; for example, the input signal function may be 
represented as f 0 (x,y) . Process 68 of Figure 7 thus 
operates to project the input signal function into 
bilinear spline space, m this regard, consider a 
rectangle [a, b] by [c, d] to be partitioned into 2" 
subrec tangles of equal size, each subrectangle being 
represented as [x if x^J by [y,, , where: 



Xi'^r 1 ** > j =o,i 2 1 



(id 



As a result, the rectangle is represented by (2*+i) <2" + l) 
equally spaced grid points ( Xi , y j} , for i from 0 to 2', 
and for j from 0 to 2' over the rectangle [a, b] by [c, 

d] . 

In process 68, a sampled input signal sequence f (x- 
y,J over the range of i from 0 to 2', and j from o to 2'" 
is received in PGM format from format converter 12 by DSP 
60 in spline-wavelet compressor 20. In the general case 
process 68 projects the sampled inputs signal sequence 
f (x i( Yj ) by application of a bilinear spline function 
into a sequence (S I(J f ) (x,y) as follows: 
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i. 0 j. 0 ' D-a d-c 

(13) 

We will represent the matrix of z 4tJ as the sequence of 
input approximation coefficients {c 0 } . Process 68 
concludes by storing the sequence {c 0 } in image memory 67. 

It has been found that the sequence (S 1#J f ) (x,y) has 
important properties that are useful in the compression 
of documents according to the preferred embodiment of the 
invention, and particularly in the compression of two- 
color, or binary, documents. Firstly, the sequence 
(S r<J f) (x,y) is a bilinear spline function that is 
continuous over the rectangle [a, b] by [c, d] , and its 
restrictions on the subdivided sub- rectangles U it x M ) by 
tyj' yj.xJ-for integers i from 0 to 2 X , and integers j from 
0 to 2 J are all bilinear polynomials. Secondly, the 
sequence (S 1(J f) (x,y) agrees exactly with the sampled 
input signal sequence f <x lf y,) at the grid points. 
Thirdly, the sequence (s x>J f) (x,y) has the second order of 
approximation, in that: 



\(S Z J f) (x,y) -£{x,y) \z (constant) 2-*<™ 

(14) 

for all points (x,y) within the rectangle [a, b] by [c, 
d] , and for all smooth functions f(x,y), with the 
constant being independent of the number of grid points 
and grid lines. 

Following projection process 68, spline-wavelet 
decomposition may now be done, in the general sense, by 
decomposition of the input approximation coefficient 
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sequence {c°} into low-pass and band-pass components. The 
abHaty to perforin such decomposition is due to the 
multi-resolution analysis properties discussed above. 

For purposes of explanation, in a one -dimensional 
case, let one -dimensional functions f i (x) and g } (x) be 
represented as follows: 



k 

(14) 
(15) 

From multi-resolution analysis, an approximated signal 
f„(x) can be decomposed into the sequence: 

U) (x) +...-g w (*) ♦/„_„,(*) 

, (16) 
where m' < m, and where g, (x) e W m and f i (x) s v,. 



Recalling from multi -resolution analysis that spl 
space v 3#l = v, e Wj , that v s c V w and that w, c w, lf 
terms of the functions f(x) and g(x), decomposition may 
be considered as: 



me 

in 



t )tl (X) = f d { X ) + g 3 (x) (17) 

In this embodiment of the invention, the function g, (x) 
provides the higher- frequency details of the image (i e 
edges and corners) at the level of decomposition, 
while the function f i (x) provides a low-frequency 
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approximation of the image. While one -dimensional 
functions f (x) and g(x) are used hereinabove for 
explanation, it is of course to be understood that two- 
dimensional decomposition functions f(x,y) and g(x,y), as 
useful in the decomposition of a two-dimensional 
functions representative of a document, may be obtained 
in a similar way (i.e., via the tensor product). 

One can thus determine a relationship between a 
higher-level approximation coefficient sequence {c^ 1 } and 
its lower- level component approximation coefficient 
sequences {c 3 }, {d 1 } as follows: 

(18) 
(19) 

indicating that spline -wavelet decomposition according to 
the present embodiment of the invention may be performed 
by convolution of the approximation coefficient sequences 
with decomposition sequences {a n }, {b„} . 

Accordingly, referring now to the illustration of 
the generalized method of Figure 7 for the decomposition 
of a document, subprocesses 70 and 71 of decomposition 48 
are performed upon the input signal coefficient sequence 
{c 0 }; Figure 7 shows subprocesses 70, 71 operating upon a 
generalized sequence {c J }, considering that the input to 
processes 70 and 71 will be a previously decomposed 
component sequence in the case where decision 51 (Figure 
2) requires additional decomposition to obtain the 
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TZFJZZT* ratio - According to this — 

invention, processes 70, 71 analyze the incut 
sequence in row-wise fashion fir«r c I 
MrfnriB(! "smon first. Subprocess 70 

performs the convolution of the sequence (cM with a 
coefficient sequence /a.) tv, af ' 
select i • M corresponds with the 

selected linear B- spline fnn^, „« 
r6la . . spune runction, as noted above 

relative to Figure 5a Th,-» , 

followed bv a !T convolution of process 7 o is 

this desampling may be an inherent result of the 
convolution operation. The result of process 72 Is 
sequence {c>-}, which is then stored H u 
memory 67. red back lnto ima 9e 

Similarly, to derive the row-wise high-pass 
component of the input sianai , • 

ocyuence (c n ) that corresponds wit->, 

function m process 71 ™t " , Sele " ed WaVelet 
is fouled bv „V "-volution of process 71 

operation is discarded f- ? convolution 

sample. The resuit L ' p OC e s^ .'ST 
which *.u Process 73 is the sequence (d^ 1 ) 

which „ then stored back into image memory 6 7 along w 4 h 
the low-pass sequence {e *-) i„ process 72. * 

decor~t::-ri:u": ^r^r in w r the 

decoded, but in a coW Jl e LnL ™ 

subprocess 73 convolves the blur image i e W ■ , 
both spline function coefficient sequence la ) J , 

function coefficient sequence ,b„,. ToUoled^t ^ 



WO 96/09718 



PCT/DS95/12050 



50 



incorporating therein a downsampling by a factor of two. 
The result of subprocess 73 is the blur portion of the 
two-dimensional image (referred to as the LL component) 
corresponding to the column-wise low-pass filtered 
5 component of row-wise low-pass filtered result {c^ 1 }, and 
a higher- frequency component (referred to as the LH 
component) corresponding to the column-wise low-pass 
filtered component of the row-wise high-pass filtered 
result . Similarly, subprocess 74 convolves and 

10 downsamples the wavelet component {d** 1 } with both spline 
and wavelet function coefficient sequences {an}, {b n }, 
respectively. The result of subprocess 74 is the high- 
frequency component of the two-dimensional image referred 
to as the HL component, which corresponds to the column - 

15 wise high-pass filtered component of the row-wise low- 
pass filtered result {c J - 1 }, and the highest frequency 
component referred to as the HH component, which 
corresponds to the column-wise high-pass filtered 
component of the row-wise high-pass result {d j ' x } . The 

20 component results LL, LH, HL, HH are stored back into 
image memory 67 in process 75, for quantization by 
process 50 of the flow of Figure 2. 

(i) Dual Base Wavelet Decomposition 

25 

According to a first embodiment of the invention, 
decomposition process 48a takes advantage of the duality 
principle for certain wavelets, as described in Chui, et 
al., "Fast integral wavelet transform on a dense set of 

30 time-scale domain", CAT Report 310 (Center for 

Approximation Theory, Texas A&M University, September 
1993) . Through use of the duality principle, it has been 
discovered that each element of both decomposition 
coefficient sequences {a n }, {b n } , and of both 

35 reconstruction coefficient sequences {p n }, {q„} may be 

expressed as a rational number. Integer scaling of these 
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sequences thus allows for all of the matrix operations of 
process 48a to be integer operations, and can thus be 
performed very quickly and efficiently by integer-based 

60 ' SUCh as the ™S 320C25 or the like, in spline- 
wavelet compressor 20. it is therefore preferred 
according to the present invention, that the default 
condition of spline -wavelet compressor be set to perform 
decomposition according to process 48a, using the dual 
wavelet approach. 

For purposes of explanation, and as noted in the 
above-referenced Chui et al. paper, a "dual" function 
* B (x) of the mth order B-spline function * B (x) exists, 
such that: 



and such that: 



$„U) e clos Li span I ^(x-k) | kez ) 

(20) 



*' J 0 k*l 



(21) 



It is preferred that the order m be even -numbered; the 
most useful case is the linear case (m=2), in which: 



(22) 



Because of this relationship, one may perform wavelet 
decomposition in dual space, using linear dual spline 
function 0 2 (x) together with linear dual wavelet f unct 
*a<x) (i.e., the dual of linear wavelet function tf a ( x ) ) 



ion 



WO 96/09718 



PCT/US9S/120S0 



52 



Linear wavelet function ^ 2 (x), in this example, is 
preferably the following function: 



i|r 2 (x) : =£ qjs 2 (2x-n) 

a 

(23) 

where, for m generally: 




w=0 ,1, . . 2m~2 



(24) 

For a discussion of these functions in the general case 
(for order m) , attention is directed to Chui, An 
Introduction to Wawi^p (Academic Press, 1992) , 
incorporated herein by this reference; particular 
attention is directed to pages 182-186 in this regard. 
By way of the duality principle noted above, the dual ot 
linear wavelet function ^ (x) may therefore be expressed 
as follows: 

* . (25) 

Id. , at 185. 

By way of further explanation, use of the dual base 
wavelet decomposition technique will first be described 
relative to a one-dimensional sampled input signal 
f(k/2 J ), where 2 J is the number of sample points in the 
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input sequence and where k is the sample point index in 
the sequence. Projection of the sampled input signal 
onto spline space results in the function f j(x ) as 
follows: 



(26) 



The function f a (x) thus provides a continuous 
representation of the sampled input signal f (k/2') As 
noted above relative to process 68 of Figure 7, since the 
approximation coefficient sequence {c k '} is exactly the 
or lgi nal sequence of inpuf signal samples, projection of 
the function £,( X J into spline space as a set of 
approximation coefficients requires no computation in 
thas case and results in the original sampled input 
signal sequence f (k/2 J ) . 

Next, using the duality principle according to this 
embodiment of the invention, the continuous function 
t,(x>, as represented by the approximation coefficient 
sequence represented directly by the sampled input signal 
sequence f <k/2'> , is changed into a dual approximation 
coefficxent sequence by way of a coefficient sequence q* 
determined by equation (22) above as follows: 



6 2 J 2 J 2 J 



(27) 



Referring back to the decomposition tree of Figure 
5a, the following dual space decomposition formulae may 
be readily derived: 
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l-2k-m 

(28) 

£ 

J-2Jr-3m*2 

(29) 

using the finite decomposition sequences a k/ b k , as 
follows : 



if — 0 f 1 , • , . , jt? 



(30) 



m f > 



£=0, . . . ,3in-2 



(31) 



In the linear (m=2) case, the sequences a k( b k equal: 



{a Q ,a l ,a 2 )=l{i,2 t l), a k =0 for all other k ' 

(32) 

ib 0 ,b lt b 2 ,b 3 ,b 4 }'-^{i t -6, 10,-6,1), b k =0 for all other k 

(33) 

Further, the reconstruction sequences {p k }, {a*} equal the 
decomposition sequences {a k , b k } . m addition, reference 
to the summation limits in equations (28), (29) will show 
that the convolution operation will also result in 
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desampling of the results, by a factor of two. As will 
be Seated hereinbelow. the results of this convolution 
operation win provide both low- pas, and high-pass 
cogent results that can be stored in the sen* memory 
-pace as that which originally contained the input 
setjuence . 



As is evident from the foregoing, the decomposition 
sequences (a k , h k} will be ^ advantageQus ^ fche 10n 

standpoint of implementation into modem data processing 

equipment, since each sequence is a fin^o « 

yuence is a finite sequence of 

rational numbers. The decomposition routine is thus very 
Similar to a digital m (finite impulse response) 

48a 11' dUal ^ WaVel " process 

48a xs very efficient when performed by spline-wavelet 
compressor 20 on two-dimensional input data 
representative o, a document, as will now be described 
relative to Figures 8 and 9. 

Decompression process 48a of Figure 8 begins with 
process 76 , in which the two-dimensional input signal 
coefficient sequence (c'J is projected into dual saline 

ZTi^^T^' ^ 3 in the --nclature 

coe«i" T" 0rd " ° £ d «™"°". su=i> that the 
coetficient sequence (C) refers to the original input 

signal coefficient sequence, m the two-dimensionT 
case, input signal coefficient sequence {c ') refers to the 
sequence ( S „„ (x , y) . Process ?6 generates ^ 

ITZITS™ ^ " 3 SerlM ° f "cording 
to the following sequence, analogously to equation (22, 
above, as follows: 

a i.J=<Ci- l , J - 1 *c J . 1 , J . 1 .c J . 1 . ji *c 1 . l . J . 1 ) n6 c J ^4(c J . 1 . J »c i . J . 1 »c J . J .,» 
where 1341 
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c -i,j = c z*.i.j = c i.-i = c i. 2 '*i = 0 for a* 1 i'J 



As a result, one may express the relationship between the 
spline space coefficient sequence {c j } and its dual 
5 coefficient sequence {c 3 } as follows: 

(35) 

Upon completion of process 76, the dual coefficient 
10 sequence {c j } is stored back into image memory 67. 

Process 78 and 80 are then performed by way of which 
the row-wise decomposition processes are performed by DSP 
60 using integer operations, as enabled by the dual base 

15 wavelet technique according to this embodiment of the 
invention. As noted above, the input sequence {c 3 } 
consisted of a two-dimensional array of values in PGM 
format; as such, the dual sequence {c 3 } similarly consists 
of such an array. Process 78 performs convolution of 

20 each row of the dual array sequence (c j } with a sequence 
{a*} derived as noted above, in the manner of a low-pass 
filter. In this example, where order m - 2 (i.e., linear 
spline-wavelet analysis) , the convolution of process 78 
consists of the point -wise multiplication of each row in 

25 dual sequence {c j } with a sequence {a k } derived according 
to equation (2 8) noted above: 



WO 96/0971* 



5? 



PCTAJS95/12050 



(28) 



where Jc is the position of each entry within the row of 
dual array sequence As noted in equation (32) for 

the linear case, the sequence {a k } is defined as: 

la 0t a 1 .a 2 Ul (1,2,1), 3jt =o for all other k 



(32) 



The 1/4 term may be applied to the resultant data later 
allowing the convolution of process 78 to be performed ' 
solely with integer values. As noted above, the 
convolution of process 78 results in a convolution result 
{e» l ) that is inherently downsampled by a factor of two. 
For example, only the even-numbered values of the 
convolution results may be retained (given the summation 
limits noted above) , with the odd-numbered values 
discarded. As will be evident hereinbelow. this 
downsampling allows for the same image memory space to be 
used to maintain the decomposed image. 

Similarly, process 80 performs convolution of the 
dual space array sequence {c>} with a sequence {b k } , 
derived as noted above, in the manner of a high-pass 
filter. As in the case of process 78, where the order m 
=2 (i.e., linear spline -wavelet analysis), the 
convolution of process 80 consists of the point-wise 
multiplication of each row in dual sequence {&) with a 
sequence {bj according to equation (29) noted above: 
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5 r x = E 

(29) 

As noted in equation (33) above, for the linear case, the 
sequence {bj may be calculated as follows: 

{b Q ,b lt b 2 ,b 2 ,b A )=-±{l,-6,10,-6,l}, b k =0 for all other k 

(33) 

Again, the 1/24 division may be performed at a later 
time, to allow the convolution of process 80 to be 
performed using only integer values. As noted above, the 
row- wise convolution of process 80 provides results {d 5 * 1 } 
that are downsampled by a factor of two, e.g. by 
retaining only the even-numbered entries. 

Upon completion of the row-wise decomposition and 
downsampling of processes 78, 80, the downsampled 
decomposed sequences {c^ 1 }, {d*" 1 } are stored in image 
memory 67, in a form in which the left-hand side of the 
image corresponds to the low frequency results {c^ 1 }, and 
in which the right-hand side corresponds to the high 
frequency results {d j - 1 } . Attention is directed to Figure 
9 for a visual representation of the operations of 
processes 78, 80. Array 90 indicates the contents of 
input dual array sequence {c j }, prior to row- wise 
decomposition. The inherent downsampling in the results 
of each of processes 78, 80 provides a combined 
downsampled sequences {c^ 1 }, {d 3 * 1 } that is stored by 
process 82 in image memory 67 in the same memory space as 
the original array, as shown by array 92 of Figure 9. 
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The results of the row-wise 

decomposition are then subjected to column-wise 
decomposition, for both low-pass and high-pass cases, in 
processes 84, 86 respectively. Process 84 retrieves each 
column of the stored results for sequence { e M} (from 
array 92), and performs a decomposition into another pair 
of low and high frequency sequences in the same manner as 
process 78 discussed above, except that the index k now 
refers to positions within the particular column under 
analysis. The results of this decomposition of process 
84 are inherently downsampled by a factor of two (e g 
by keeping only even-numbered values), as discussed' " 
above . 



Similarly, process 86 performs low-pass and high- 
pass decomposition of the results on a column-by- 
column basis. The decomposition of process 86 is a 
convolution in similar f ashiori as discussed hereinabove 
except that the index * now refers to position within the 
column under analysis. The results of column- wise high- 
pass decomposition process 85 are also inherently 
downsampled by a factor of two, as noted above. 

The results of processes 84, 86 then correspond to 

st°or r e rrr nts of the input duai «* «■ 

stored back xnto image memory 67 in process 88. These 
components are referred to as the LL, LH, HL, HH 
components. By way of explanation, the LL component , 
consists of those sequence entries resulting from column- 
wise low-pass process 84 upon the row-wise low-pass 
results of process 78; the HL component consists of 

the results of column-wise low-pass process 84 upon the 
row-wxse high-pass results {d^} of process 80 
Sxmilarly, the LH component consists of the results of 
column-wise high-pass process 86 upon the row-wise low- 
pass results (el") of process 78, while the HH component 
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consists of the results of column-wise high-pass process 
86 upon the row-wise high pass results {d 5 * 1 } of process 
80, Figure 9 illustrates, with array 94 , the arrangement 
of these four components in image memory 67, with A=LL., 
B-HL, C=LH, and D=HH . 

Upon storing of the decomposed components back into 
image memory 67 in process 88, the input document image 
is ready for quantizing in process 50, as will be 
described hereinbelow. It should be apparent to those of 
ordinary skill in the art, particularly with reference to 
equations (32) , (33) , that this embodiment of the 
invention provides the significant advantage that spline- 
wavelet decomposition may be performed using spline and 
wavelet functions of finite support, and which involve 
only integer calculations. As such, the decomposition 
process of this embodiment of the invention may be done 
at very high speed, similar to a digital FIR filter, or 
alternatively with relatively primitive processing units, 
while maintaining high quality of the compressed 
document , 

In addition, it will become apparent, from the 
description hereinbelow regarding decompression of the 
document, that reconstruction of the document may be made 
using the same spline and wavelet sequences {a k }, {b k } as 
used in decomposition of the document. As such, 
reconstruction may also be performed solely with integer 
operations, and thus at high speed or with inexpensive 
processors . 
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lijj Interpol atory wawl fl » 

Referring back to Figure 2, according to an 
alternative embodiment of the invention, decomposition 
process 48 may be performed by way of interpolatory 
wavelets (shown as process 48b) . As noted above, it is 
contemplated that interpolatory wavelet decomposition 
will be most useful where the compression and 
decompression speed is of the highest importance, at a 
cost of somewhat reduced reproductive quality. 

According to this embodiment of the invention, the 
document image is decomposed by way of the centralized B- 
spline scaling function, together with its corresponding 
wavelet. Figure 10a illustrates the centralized linear 
B-spline function * L (x), which is defined as follows: 



<M*>= { 1_W 

0 o Chez wise 



(36) 



This expression is a unit left shift of the cardinal B- 
spline of equation (1) above. The corresponding wavelet 
function * L (x) to centralized linear B-spline function 
4>u(x) is as follows: 



■ <l> t (2x-i) 

(37) 



and is illustrated in Figure 10b. The wavelet function 
iMx) has an interpolatory property, and as such is 
commonly referred to as an interpolatory, or 
interpolating, wavelet. Further information regarding 
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interpolatory wavelets may be found in Chui and Li, 
"Dyadic Affine Decompositions and Functional Wavelet 
Transforms", CAT Report (Center for Approximation 

Theory, Texas A&M University, April 1993) . 

From the linear B-spline, scaling function ^(x) may 
be expressed as follows: 

<M*). = -|<|> t (2x+l) ♦ $ L (2x) * !<t> t (2x-l) 

(38) 

then : 

$ L (2x) = $ L (x) - ±y L (x+l) - -|t L (x) 

(39) 

Using the general wavelet decomposition formula of: 
4>(2x-ic) - 5>*-aj*U-.Z> + Vb k . 21 y(x-1) 

(40) 

one may then readily show that, for the centralized 
linear B-spline scaling function ^(x) and its 
interpolatory wavelet \p L (x) : 

{a„} ={..., 0, l, o, . . .) 

{*>»} - {• • •/ 0, l, 0, . . .} (41) 

both over non-negative integers. 

Process 48b of Figure 2 is thus performed 
identically as process 48a, described above relative to 
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Figure 8, except that the decomposition sequences {a„}, 
{b n } of equations (41) are used in processes 78, 80, 84 
86. As such, the interpolator wavelets of this 
embodiment of the invention provide the same advantages 
in decomposition, as described hereinabove relative to 
the dual base wavelet technique of process 48a, in that 
integer operations may be utilized for such 
decomposition . 

However, differently from the dual base technique 
described hereinabove, the use of interpolator wavelets 
require the reconstruction sequences { Pk} , {qk ) to be 
different from decomposition sequences {aj, {b n } . From 
equation (39) above: 



(42) 



As such, the reconstruction sequence {pj f or the 
interpolator wavelets (the use of which will be 
described in detail hereinbelow) will have p , = « p - 
1, and Pl = - Hf witn all othfir valueg of p eguai ^ 

Given the simple expression of equation (37) for ^(x) 
the reconstruction sequence {q,} will have only a single 
non-zero element, namely * . x , with all other q£ 
q equal to zero. 



.wavelet 

decomposition using S niino. u , V6lp , p a „i^. 

According to another alternative embodiment of the 
invention, specifically the third approach noted above 
decomposition process 48 may be performed according to 
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another technique which will be referred to herein as 
"wavelet packets" or "spline wavelet packets". As will 
be apparent from the description hereinbelow, this 
decomposition (or compression) approach utilizes a full- 
tree decomposition, rather than the half-tree approach 
discussed above. Full- tree decomposition refers to 
decomposition in which both the low-pass and the high- 
pass (or band-pass) components are decomposed when going 
to the next level of decomposition. 

The use of orthogonal wavelet packets in wavelet 
analysis is known, as indicated by Coifman, Meyer, et 
al . , "Signal Processing and Compression with Wave 
Packets" , (1992). However, these wavelet packets are not 
spline -based, and are not symmetric, and as such their 
use in fields such as image compression and decompression 
would introduce undesirable phase distortion. 

According to this alternative embodiment of the 
invention, process 48c (Figure 2) performs decomposition 
of the document image by way of non- orthogonal, 
symmetric, spline-based wavelet packets. The 
mathematical theory behind this class of wavelets is 
presented in Chui and Li, "Nonorthogonal Wavelet 
Packets", SIAM J. Math. Anal . . Vol. 24, No. 3, (SIAM, May 
1993), pp. 712-738. According to the present invention, 
these spline -based wavelet packets are used to further 
decompose the results of data, corresponding to a 
document, that are decomposed to a first level by 
application of a scaling function and the corresponding 
wavelet function. This further decomposition provides 
higher compression ratios and higher quality picture 
reproduction, when compared against the dual -base 
technique (process 48a of Figure 2) described 
hereinabove . 
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In contrast to the decomposition approach 
illustrated in Figures 5a, 5b, where only a single branch 
(the {c n i} branch of Figure 5a) is applied to subsequent 
decomposition stages, both of the low-pass and high-pass 
components are further decomposed according to this 
wavelet packet technique. 

Figure lla illustrates the decomposition "tree" 
according to this alternative embodiment of the 
invention. As is evident therefrom, two-dimensional 
nomenclature is required to indicate the decomposition 
component of interest, since components of the n+1 level 
can come from either low-pass or high-pass results from 
the prior level; the nomenclature used in the tree of 
Figure lla identifies each component sequence {c"-"} as 
the m" lowest frequency component above the spline 
component in the n th level of decomposition. For example, 
sequence {c 2 - 3 ) is the sequence of coefficients 
representative of the second lowest frequency component 
above spline component {c 0 - 3 } in the third level of 
decomposition. 

Figure lla illustrates that each component sequence 
{c-- n } is decomposed, in the next level of decomposition, 
into a low-pass and a high-pass component, each of which 
is itself decomposed in the following level of 
decomposition. In the tree of Figure lla, the input 
coefficient sequence {c 0 - 0 } (corresponding to the input 
signal function f (x) ) is convolved with scaling function 
coefficient sequence {a n } to produce a low-pass component 
coefficient sequence {c 0 - 1 }, and is also convolved with 
wavelet function coefficient sequence {b„} to produce a 
high-pass component coefficient sequence {c 11 } . For the 
next level of decomposition, low-pass component 
coefficient sequence {c 0 - 1 } is convolved with scaling 
function coefficient sequence {aj to produce a second 
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level low-pass component coefficient sequence {c 0 - 2 }, and 
is also convolved with wavelet function coefficient 
sequence {b n j to produce a high-pass component coefficient 
sequence {c 1 - 2 } . To this point, the decomposition is 
similar to that described hereinabove relative to the 
dual-base decomposition and interpolatory wavelet 
decomposition . 

In the next level, however, according to the wavelet 
packet technique according to this embodiment of the 
invention, the first level high-pass component 
coefficient sequence {c 11 }, which is basically a wavelet 
component, is also convolved with wavelet function 
coefficient sequence {bj to produce a low-pass component 
coefficient sequence {c* 2 }, and is also convolved with 
scaling function coefficient sequence {a n } to produce a 
high-pass component coefficient sequence {c 3 ' 2 }. One 
should note that the coefficient sequences applied to a 
previous high-pass component are reversed from that of 
the tree of Figure 4a, such that the high-pass component 
of a previous high-pass component is obtained by 
convolution with. scaling function coefficient sequence 
{a n }, and so that the' low-pass component of a previous 
high-pass component is obtained by convolution with 
wavelet function coefficient sequence {b„} . Additional 
levels of decomposition can then continue, for each of 
the component coefficient sequences {c"- n } so generated, 
until the desired compression ratio is obtained. 

The basic spline scaling function and corresponding 
wavelet function utilized according to this alternative 
method of the invention is governed by a family of basis 
functions. This family includes a series of functions n lt 
where n 0 is a spline scaling function and where each 
function ji 4 {for i > 0) is a wavelet function. In the 
general case, where /i 0 (x) is equal to the scaling function 
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0(x), the first wavelet function ^ will equal the 
corresponding wavelet function *( X ) , and the progression 
of wavelet functions will be as follows: 



and (43) 

(44) 

As a result, the wavelet packet basis functions (i can be 
generated iteratively, in the general sense, by using the 
scaling function *<x) and the corresponding wavelet 
function <Hx). Accordingly, a component coefficient 
sequence {c B . n } at any level of decomposition, including 
the original input coefficient sequence {c"'«} can be 
obtained by the linear combination of wavelet packets. 

By way of explanation, decomposition according to 
this alternative technique will now be described in the 
case of a one-dimensional function f (x) . First, as in 
the prior cases, the input function f (x) is projected 
into the scaling function, or spline, space as follows: 

fix) = £c;-°u 0 (2^-j) =£c/'°4.(2x-j) 

J 3 

(45) 

The wavelet packet decomposition of {c 0 - 0 } is then 
governed by the following formulae: 
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k 

(46) 

where : 

^ = j 0 for even k 
* 1 for odd k 

(47) 

and where: 

/ *n . / {a J for A * = 0 
{2n ' 1 (bj for A, = 1 

(48) 

The coefficient sequences {aj, {b n } are, again, the 
spline and wavelet coefficient sequences determined hy 
selection of the scaling function and wavelet function 
selected for the decomposition. According to this 
embodiment of the invention, the linear and cubic 
coefficient sequences {a n }, {b n } preferred for use in the 
wavelet packet decomposition of digital documents are 
listed in Appendix A hereto. Decomposition is then 
performed according to the tree diagram of Figure lla, to 
the extent desired. 

As will be described in further detail hereinbelow, 
reconstruction of a decomposed representation is 
performed by convolution of high-pass components with a 
reconstruction coefficient sequence {qj and low-pass 
components with a reconstruction coefficient sequence 
{Pk}/ in full-tree form, as shown in Figure lib. The 
reconstruction formula utilized in this operation is as 

follows : 
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(49) 



Referring now to Figures 12a, 12b, 13, and 14 
process 48c in which a two-dimensional function f (x y) 
representative of a document, expressed as an array'of 
sample values in byte-packed PGM format, is decomposed 
according to the wavelet packet technique, will now be 

trilTJ" detai1 ' ShOWn in F±gUre 12a < in P~— 
96, DSP 60 projects the input data into spline space (as 

« coefficient sequence {c ---}, . As described hereinabove 
for a digital array of data as provided by format 
converter 12, the coefficient sequence corresponds to the 
values m the digital array f (x , y) . The arrangement of 
input coefficient sequence {c 0 ,} in an array of 
coefficients (x) is shown in Figure 13a, which is at the 
beginning of the decomposition tree of Figure 14 . 

Decomposition of the input coefficient sequence 
{Co.o) (or array {x}) then begins with processes 98, 100 
in which the sequence {<=„} is convolved, in row . wise ' 
fashion, with decomposition coefficient sequences (a } 
{b n } to produce the low-pass and high-pass component 
coefficient arrays {x}, { A} , respectively. Decomposition 
coefficient sequences {a a} . {b n} are based upon scaling 
functions and wavelet functions suitable for use in this 
wavelet packet approach, such as those shown in Appendix 
A. Each convolution in the decomposition sequence 
contains downsampling by a factor of two, as in the cases 
discussed hereinabove. As such, as shown in Figure 13b 
each row of the image data contains a row-wise low-pass' 
component coefficient array {x} and a row-wise high-pass 
component coefficient array {a} . For purposes of 
description of Figures 13 and 14, the low-pass component 
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coefficient sequence will retain the designation of the 
sequence from which it was generated (hence array {X} in 
Figure 13b is the low-pass component of array {x} in 
preceding Figure 13a) . 

The result of process 98, namely the low-pass 
component of the input image data array is then again 
decomposed, in row-wise fashion, in processes 102, 103. 
Process 102 convolves coefficient array {X} of Figure 13b 
with spline decomposition coefficient sequence {a„}, 
including downsampling, to generate another row-wise low- 
pass component, shown as coefficient array {X} in Figure 
13c. Process 103 convolves coefficient array {X} of 
Figure 13b with wavelet decomposition coefficient 
sequence {b n }, including downsampling, to generate a row- 
wise high-pass component, shown as coefficient array {B} 
in Figure 13c. 

The high-pass results from process 100 are similarly 
decomposed again, in a row-wise direction, in processes 
104, 105. Process 104 convolves the high-pass 
coefficient array {A} of Figure 13b with wavelet 
decomposition coefficient sequence {b„}, including 
downsampling, to produce a low-pass coefficient array {A} 
of Figure 13c. Similarly, process 105 convolves high- 
pass coefficient array {A} of Figure 13b with spline 
decomposition coefficient sequence {a„} , including 
downsampling. to produce a high-pass coefficient array 
{C} of Figure 13c. As noted hereinabove, according to 
this wavelet packet technique, the spline decomposition 
coefficient sequence {a„} and wavelet decomposition 
coefficient sequence {b n } are reversed, in this second 
decomposition pass when applied to the high-pass results 
of the first decomposition pass. 
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The results of processes 102, 103, 104, 105 
(together corresponding to the arrangement illustrated in 
Figure 13c) are then each applied to column-wise 
decomposition processes 106LL, 106LH, 106HL, 106HH, 
respectively. Figure 12b generically illustrates the 
subprocess steps performed in each of column-wise 
decomposition processes 106LL, ioslh, 106HL, 106HH. 

Referring to Figure 12b, subprocess 108 performs the 
low-pass decomposition of its corresponding components 
(see Figure 13c) in a column-by-column manner, by 
convolving the coefficient arrays with spline 
decomposition coefficient sequence {a n } in the manner 
discussed above, which includes downsampling by a factor 
of two. As a result, each of the coefficient arrays {x} , 
{B}, {A}, {C} of Figure 13c provide low-pass coefficient 
arrays {X}, {b}, {a}, {c} , respectively, as shown in 
Figure 13d. Subprocess 110 similarly convolves its 
corresponding coefficient array of Figure 13c with 
wavelet decomposition coefficient sequence {b n } and 
downsamples the result by a factor of two. As a result, 
each of the coefficient arrays {X}, {B] , {a}, {c} of 
Figure 13c thus also provide high-pass coefficient arrays 
{E}, {f}, {g}, respectively, as shown in Figure 13d. 

The results of this first column-by- column 
decomposition step are then repeated for a second pass, 
as before. The low-pass results of subprocess 108 are 
convolved in a corresponding subprocess ill, in column- 
wise fashion, with spline coefficient sequence {a n j , 
including downsampling; the cumulative effect of 
subprocess 111 for all of the results of processes 102, 
103, 104, 105 is to produce low-pass coefficient arrays 
(*) i {B}, {A}, {C} of Figure 13d. Subprocess 112 
convolves its corresponding high-pass coefficient array 
W. {B}, {A}, {C} of Figure 13d, in column-wise fashion, 
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with wavelet coefficient sequence {b„}, with the results 
downsampled, to cumulatively produce high-pass 
coefficient arrays {h}, {j} , {l}, {n} , respectively. 
Similarly, each of the high-pass coefficient arrays {D}, 
{E}. {F}/ {G} of Figure 13d from subprocess 110 are 
convolved, in a corresponding subprocess 113, in column- 
wise fashion, with wavelet decomposition coefficient 
sequence {b D j (downsampled) to cumulatively produce low- 
pass component coefficient arrays {D}, {e}, {f}, {G} 
shown in Figure 13e. Each of high-pass coefficient 
arrays {D}, {E}, {F}, {G} of Figure 13d are also 
convolved in a corresponding subprocess 114, in column- 
wise fashion, with spline decomposition coefficient 
sequence {a„}, including downsampling, to cumulatively 
produce high-pass component coefficient arrays {i}, {k}, 
{M}, {0} of Figure 13e. 

The results of subprocesses ill, 112, 113, 114 in 
each of processes 106LL, 106LH, 106HL, 106HH are then 
stored by process 116 in image memory 67, in the form 
illustrated in Figure 13d. Accordingly, the full-tree 
decomposition of Figure 14 is complete at this time, with 
the "blur" image of the input image sequence represented 
by the lowest -pass component of the row-wise and column- 
wise decomposition, represented by coefficient array {X} 
of Figures I3e and 14. All of the other coefficient 
arrays {a} through {0} of Figure 13 e represent wavelet 
packet components from this decomposition. 

According to this alternative embodiment of the 
invention, the decomposition tree of Figure 13e, and in 
general the decomposition tree of Figure 11a, may be 
"pruned", or stopped, at any particular component. 
Referring to Figure lla, it may be possible to stop the 
decomposition process for an intermediate decomposition 
component, for example at sequence {c 2,2 },- in this 
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example, the reminder of the coefficient eequencee in 
SL^T "° Uld te 0btalMd by ™»"on ^ the 

(="^ouid ; except that neither of se9uences - 

(c } would be generated. This aUows for a reduction in 
the amount of data to be atored. and proceased in 
aubsequent levels, particularly if no additional 
compression thereof is available. For example a 
particular sequence result of a decomposition may have 
all values equal to one another; further decomposition 
would not provide any additional compression 

pro^LT? ° V " thaC " hiCh 3 iOSSleaS -uld 
provide. Pruning of the decomposition tree at such a 

result would thus be advisable. 

When pruning of the full decomposition tree 
according to the wavelet packet technique is used, 
however, the arrangement of data in the resulting array 
must also be indicated within the data stream sent tT 
downstream processing units (i.e.. decompression system 
30) . m order to communicate which components of the full 

Figure 15. an example of the data frame useful in 
communicating the results of wavelet t>act»h x. ■ ■ 

will now be described Th, „ I . decomposition 
aescrioea. The data frame shown in Figure is 
corresponds to the format aa atored in image memo^ 67 
upon complete of the decomposition process (prior to 
the quantization, lossless compression, and other 
processes described hereinbelow) , and may also correspond 
to the compressed image data as communicated over network 
26 or as stored on disk 22, 24 (after quantization, 
lossless compression, and the other processes described 
hereinbelow) . 

As shown in Figure 15, data frame lie consists 
primarily of a data portion 120, which contains the 
coefficient sequence results of the decomposition process 
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described above. Header 119 indicates the beginning of 
data frame 118, and contains conventional information 
regarding the length and identity of data frame 118, as 
does header portion 123; trailer 121 follows the data 
5 portion 120 to indicate the end of data frame 118, and 
may also contain identity information. Part of the 
overall header of data frame 118 (i.e., the information 
preceding the actual data portion 120) according to this 
embodiment of the invention is tree map 122, which 
10 contains information concerning the components contained 
within data portion 120, especially considering the 
availability of "pruning" of the decomposition tree 
allowed according to the full-tree wavelet packet 
decomposition method described hereinabove. 

15 

Tree map 122 includes a first word 124 that 
indicates the number of decomposition levels performed. 
In this embodiment of the invention, map words 126 are 
provided for each decomposition level to indicate which 

20 components are present at each level of decomposition; as 
such, word 124 is necessary to indicate the number of map 
words 126 to follow. Each map word 126 contains a number 
of characters {which may be single or plural bits) equal 
to the number of possible components for that level; in 

25 other words, the m ch level of decomposition has 2™ 

possible decomposition components. As such, map word 12€ 0 
has one character as it corresponds to the zeroeth level 
of decomposition; it may therefore be possible, given the 
construction of header 119, 123, to eliminate map word 

3 0 126 0 since it merely indicates the presence or absence of 

any data in data portion 120. First level map word 126 x 
contains two characters, considering that the first level 
decomposition results in one low-pass component and one 
high-pass component. Second level map word 126 2 contains 

35 four (2 2 ) characters, third level map word 126 3 contains 
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eight (2 3 ) characters, and so on, for the number of 
decomposition levels performed. 

Figure 16 illustrates the decomposition tree of 
Figure 14, pruned so that the sequence {A} of Figure 13c 
was not further decomposed, and that sequences {B} and 
{C} of Figure 13d were not further decomposed. If, for 
example, each character in each of map words 126 contains 
a "i» to indicate the presence of a component and 
contains a "0" to indicate the absence of a component 
because of pruning, the following table indicates the 
contents of map words 126 (left -most bit containing the 
character for the lowest frequency component) : 

126 0 = ! 
126 x = ii 
126 2 = mi 
12 *3 - 1111 0011 

126, = mi 0011 0000 0011 

As a result of this construction of data frame 118, a map 
of the component sequences obtained by the full -tree 
decomposition 48c may be communicated along with the 
sequences. Of course, other techniques for communicating 
this information may alternatively be used. 

As in the case of the previous examples of this 
embodiment of the invention, the operations required of 
DSP 60 in performing the wavelet packet decomposition of 
process 48c are integer operations, given the integer 
nature of the decomposition coefficient sequences {an}, 
{b n } of Appendix A hereto. As such, the complex 
operations of process 48c may still be performed 
relatively quickly, and by processors of moderate 
capability; of course, the wavelet packet decomposition 
(and reconstruction, as will be described hereinbelow) 



zeroeth level 
first level 
second level 
third level 
fourth level 
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requires additional computing resources compared to the 
dual base technique and the interpolatory wavelet 
techniques described hereinabove. 

The wavelet packet technique provides a high degree 
of compression (by a factor of 16, for example) in each 
pass, as compared to the dual base technique and the 
interpolatory wavelet techniques. In addition, because 
of the full tree decomposition, the quality of the 
reproduction from the compressed data will be somewhat 
higher than the other techniques. As such, the wavelet 
packet technique described herein will be attractive for 
certain high quality applications, and as such is a 
useful option within compressor system 20 according to 
this embodiment of the invention. 



iii^ Completion of t he compression operation 

Regardless of the particular decomposition option 
selected as process 48 of Figure 2, the results of the 
decomposition operation, as stored in image memory 67, 
are then ready for the remainder of the compression 
process, as will now be described relative to Figure 2. 

Referring back to Figure 2, process 50 is next 
performed by quantization processor 62 upon the results 
of the decomposition stored in image memory 67. 
Specifically, the wavelet, or high-frequency, components 
of the spline-wavelet decomposition process 48 (i.e., the 
LH, HL and HH components of the dual -base wavelet 
decomposition and the interpolatory wavelet 
decomposition, and the wavelet packet components of the 
wavelet packet decomposition) are subjected to 
thresholding and quantization in process 50. It is 
preferred that quantization is not performed upon the 
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"blur" components (i.e., ll, or lx\) .u- 

^ . ' or l A /'/ as this component 

contains most of the significant information of t £ e ° ent 

Z^lT' ■° d ,"" SUCh ^ — thresholding 

would cause loss of quality without a significant 
increase in the compression ratio. 

However, quantization of the high-frequency wavelet 
components of the decomposition may readi^be IZTo^l 
since most real-world images in PCM format will consist 
primarily of low-frequency intensities, such that the 
higher-frequency wavelet components will tend to have a 
large number o, smaU, or zero, coefficient values 

TZltZ \° h Che i Praferred — " «- invention, 
hi!h I POE,Ul " lon «* —11 values in the 

discarded reqUenCy ^" — l-"*- may are 

discarded as a result n-F . 

f the quantization of process 50 
The memory requirements for storage of the coeff ic en ts 
that undergo the thresholding and quantization are thus 
*ucn reduced, even before the application of lossless 
compression techniques as will be noted below. 

As noted above, quantization processor 62 is a looic 
circuit for filtering the data corresponding to 
decomposed images in order to achieve the desired 
compression ratio, based upon one of a number of 
™ *" n "*«ion — ». The simpiest technique for 
performing quantization is referred to as "thresholding" 
where any coefficient having an absolute value less til' 
a certain threshoid value is set to zero, and where aU 
remaining coefficient values are rounded to the nearest 
integer value. The other quantization modes indicated 
above may instead be performed in process 50 by 
quantization processor 62, according to the known 
conventional techniques noted above. 
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Upon completion of the quantization of process 50, 
decision 51 is performed to determine if the desired 
compression ratio has yet been achieved. Upon the 
completion of a single decomposition process 48, the blur 
5 component of the image may be adequate to accurately 

convey the input image. This single decomposition of the 
image will provide up to a 4:1 compression ratio (for the 
dual-base and interpolatory wavelet case) or 16:1 ratio 
(for the wavelet packet case) , depending upon the memory 

10 requirements for the quantized high frequency results. 

This maximum ratio is obtained if all higher frequency 
components are discarded in the quantization process 50, 
leaving only the blur component. Decision 51 thus 
determines if the compression ratio achieved so far is 

15 adequate for the desired transmission or storage and, if 
not, passes control back to the decomposition process 48 
so that the blur component from the prior decomposition 
may again be decomposed according to the selected 
optional technique. 

20 

According to this embodiment of the invention, the 
determination of whether the desired compression ratio 
has been obtained may be done relative to a predetermined 
compression ratio. In such a case, data controller 56 
25 will maintain a count of the number of passes through 

decomposition process 48, and will perform decision 51 by 
comparing the resulting compression ratio against a 
previously stored value. 

30 Alternatively, the compression ratio decision 51 may 

be determined in a dynamic manner according to the 
accuracy with which the blur component is representative 
of the input frame image. Conceptually, such a 
determination will be a measure of the difference between 

35 the blur component and the input image block relative to 

a predetermined accuracy limit, such that if the blur 
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decomposition is within a preselected e l imit , „ 
additional pass through the decomposition process 48 may 
be performed, it is contemplated that this determination 
can be made automatically, by data controller 56 in 
decompressor 20 so that the process performed in each of 
channel compression subsystems may remain consistent, for 
example by calculating a numerical value based upon the 
sum of the coefficients in the high-frequency components 
of the decomposed image, which will indicate the 
difference between the input image to the blur image 
result of the decomposition process 48. 

whether statically or dynamically determined, upon 
decision 51 returning the result that the desired 
compression ratio has been obtained, according to the 
preferred embodiment of the invention, lossless 
compression is then performed upon the results of the 
decomposed and quantized images for the frame, in process 
52 ot Figure 2. Referring back to Figure 4, the lossless 
compression of process 52 is preferably performed by 
lossless compressor 64 according to a conventional 
lossless technique such as Huffman encoding. The 
lossless compression of process 52 is especially 
beneficial in compressing the quantized higher frequency 
components from the decomposition, considering that non- 
zero or varying values in these components will be quite 
sparse : for most video image frames. 

After the lossless compression of process 52, the 
compressed image data is then formatted for transmission 
or storage, as the case may be. it is preferred that the 
coding of the compressed image data be performed within 
compressor 20, preferably by data flow interface 66 shown 
in Figure 4, prior to its application to digital 
communications network 26 or bus 25. Besides the actual 
decomposition sequences, as compressed, the transmitted 
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compressed document image data must include information 
regarding the type of compression performed; such 
information must identify the type of lossless 
compression (if any) , the spline-wavelet decomposition 
5 process, and the type of byte-packing and number of color 
bits, used in the compression process. It is 
contemplated that such coding, including the insertion of 
this necessary data control information and document 
identity information as a header or trailer. Examples of 

10 such information include x-dimension image size, y- 

dimension image size, the number of bits used in byte 
packing, the wavelet decomposition method used (i.e., 
dual base wavelet, interpolatory wavelet, wavelet 
packet) , the number of levels of decomposition, the 

15 quantization method used, and the lossless compression 
method used. This and equivalent information and 
arrangements will be within the knowledge of one of 
ordinary skill in the art having reference to this 
specification. 

20 

3 . The decompression system 

The construction and operation of decompression 
25 system 30 according to the preferred embodiment of the 

invention will now be generally described. As in the 
case of compression system 10, decompression system 30 
may be a stand-alone system, but is preferably arranged 
so as to be an add-on card for a conventional high 
30 performance personal computer or workstation or as a 
function of a larger computer, such as a mainframe 
computer or supercomputer. It is also contemplated, as 
will be apparent from the following description, that it 
will be possible to implement decompression system 30 
35 with the same hardware as compression system 10, 

considering that decompression system 30 is performing 
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substantia!^ the inverse operation, of those ascribed 
hereinabove, and as such uses o.ite similar circuitr ^ 0 
accomplish the same. 

However, it is also contemplated that many 
applications will utilize a central compression system 
10, with many remote decompression systems 30 able to 
receive or retrieve compressed image data therefrom, m 
such an arrangement, there is no need for the remote 
stations to have compression capability, as they will be 

read-only" systems. Accordingly, the construction and 
operation of decompression system 10, and specifically 
spline-wavelet decompressor 40, as a decompress -only 
subsystem will now be provided. 

As discussed above and as shown in Figure 1 
decompression system 30 includes spline- wavelet ' 
decompressor 40 and format converter 32. Spline-wavelet 
decompressor 40 receives the compressed image data from 

26 ' ° r frora disk borage 22, 24 via bus 27, and 
reconstructs the document image from the decomposition 
sequences in the manner to be described hereinbelow 
Format converter 32 operates to reformat the decompressed 
document into the suitable form for display on video 
display 34d, printing by printer 34p, or output by way of 
another conventional output device. 

Referring now to Figures 17 and 18, the construction 
and operation of spline-wavelet decompressor 40 to 
reconstruct, or decompress, the received or retrieved 
document image data according to the preferred embodiment 
of the invention will now be described in detail 
Spline-wavelet decompressor 40 includes data controller 
156 which controls the operation of the other components 
within spline-wavelet decompressor 40. m this example 
data controller 156 presents and receives signals on ' 
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control bus 163 to control the timing, feedback and 
transmission of information through and from spline- 
wavelet decompressor 40. It is therefore contemplated 
that data controller 156 may be implemented as a 
5 relatively simple logic circuit, for example as . 

implemented into a gate -array or other semi -custom logic 
circuit, for performing these functions. 

Spline-wavelet compressor 40 also includes data flow 
10 interface 166, which receives a compressed document image 
data from DCN 26 or bus 27 in process 128 (Figure 17) . 
Interface 166 provides an interface between spline- 
wavelet decompressor 40 and network 26 or bus 27, and as 
such is able to strip header and trailer information from 
15 the received data stream which, as noted above, may 

include information necessary for decompressor 40 to 
comprehend the compression techniques used in the 
compression of the received data. Interface 166 
communicates this identity and control information 
20 contained therein to other components in decompressor 40, 
by way of various control lines, some of which are shown 
in Figure 18. 

After proper receipt and reformatting of the 
25 received document data by interface 166, lossless 

decompression process 130 is next performed by lossless 
decompressor 164 . Lossless decompressor 164 may be 
implemented by way of a conventional digital signal 
processor such as the TMS320C40 or TMS320C30 available 
30 from Texas Instruments Incorporated, the i860 processor 

available from Intel Corporation, or general purpose 
microprocessors such as the 80386 and 80486 available 
from Intel Corporation or the 68030 and 68040 available 
from Motorola, programmed in such a manner as to perform 
35 lossless decompression process 130 upon the data received 
from interface 166; alternatively, lossless compressor 64 
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may be implemented as a custom logic circuit for 
providing this function. Lossless decompression process 
130 will be performed by lossless decompressor 164 
according to the technique used in the compression of the 
data (as communicated thereto by interface 166 from the 
header data) . As noted above, these lossless 
decompression techniques include Huffman encoding, 
adaptive Huffman encoding, arithmetic encoding, LSQ 
coding, and the like. The output of lossless compressor 
64 is forwarded to dequantization processor 162, for 
dequantization in process 132. 

According to this embodiment of the invention, 
dequantization processor 62 is preferably implemented as 
a programmable microprocessor or custom logic circuit for . 
performing the functions described hereinbelow; such 
implementation is believed to be readily apparent to one 
of ordinary skill in the art having reference to this 
description. As shown in Figure 18, dequantization 
processor 162 is connected to image memory banks 167 by 
way of data bus 16ld and address bus 161a, so that 
dequantization processor 162 can store the results of 
dequantization process 132 therein, and retrieve data 
therefrom in the event that additional reconstruction is 
performed. In this example, as in the case of compressor 
20, image memory 167 is arranged in four banks, totaling 
two megabytes in capacity, in process 132, 
dequantization processor 162 dequantizes the information 
in process 132 and stores the results in image memory 
167, awaiting spline-wavelet reconstruction. 

Dequantization process 132 is performed by 
dequantization processor 62 according to the quantization 
mode selected in the compression process for the 
particular document, as noted above. The particular 
quantization mode used in the compression is communicated 
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to dequantization processor 1S2 by interface 166, based 
upon information communicated in the document data 
stream. As noted above, conventional quantization 
methods that may be used in the compression process (the 
5 inverse of which is performed in process 132 of Figure 

17) include no quantization, simple thresholding, scalar 
quantization, JPEG quantization using tables, the Federal 
Bureau of Investigation quantization standard for 
fingerprint compression, and others. 

10 

As noted above, upon completion of dequantization 
process 132 by dequantization processor 162, the results 
of the dequantization are stored in image memory 157 to 
await reconstruction by digital signal processor (DSP) 

15 160. DSP 160 is the main processing unit for performing 

spline -wavelet reconstruction process 148 of Figure 17. 
Examples of modern digital signal processors suitable for 
use as DSP 160 according to this embodiment of the 
invention are the TMS320C25 and TMS320C30 digital signal 

20 processors manufactured and sold by Texas Instruments 

Incorporated; of course, other digital signal processors 
and microprocessors may alternatively be used to perform 
the spline-wavelet decomposition operations described 
hereinbelow. DSP 160 is coupled to data bus 16 Id and 

25 address bus 161a (collectively referred to as memory bus 
161) for communication with program memory 165 and image 
memory 167. According to this embodiment of the 
invention, and similarly as in the case of data 
compression described hereinabove, DSP 160 is programmed 

30 by way of code stored within DSP 160 or in program memory 
165, to perform decomposition of the compressed document 
data in image memory 167 according to pre-calculated 
reconstruction coefficients stored in program memory 165. 
During and after reconstruction process 134, the document 

35 image data is stored in image memory 167. DSP 160 is 

also connected to control bus 163, so that it may be 



WO V6/U9718 



85 



PCT/US95/12050 



efLt t ne * ^ »« - - that it can 

process" ; ' dUri " 9 of decomposition 

egression (1 .e.. ^ ^ ~ 

oompress uT^l^" lt r thaC ^ C ° 

identified by data interface 166. The three 
reconstruction processes 134a , 134b . be 
described in detail hereinbelow 



process of process 48a described hereinabove with hioh 
pass and low-pass coef fici^ ««ove, with high- 

rprnBe , fc . coe££lc ient sequences convoluted with 

reconstruction sequences / D ) /„ l 
n «„ ^ tPk ' # i^i' respectively 

Because of the use m« ^ -, *-^v eJ .y. 

duai waveiet function , , th ? fUnCti ° n Md 

l~l c "°n the reconstruction sequences 

A . {«} e*act!y equal the decomposition sequence^Ta 7 
(M, respectively. „ . result> £he reconst ^= eS M ' 
Process X34a may aiso be done purely with 
operations, thus facilitate the decompression process 



WO 96/09718 

PCT/US95/12050 

86 



by modem data processing hardware of reasonable 
performance levels. 

As indicated from the description of the 
decomposition process hereinabove, the compressed 
document image data provided by deguantization process 
132 contains coefficient sequences corresponding to the 
■LL". »LH«, -HL- and "HH» decomposition components, from 
a particular decomposition level j. if, for example, the 
decomposition of process 48a for a particular document 
was done with a single pass (row convolution and column 
convolution), the coefficient sequences »LL", -lh- »HL« 
and »HH» stored in image memory 167 would correspond to 
array 94 of Figure 9 discussed hereinabove. 

Referring now to Figure 19, reconstruction process 
134a will now be described in detail. For the first 
pass through process 134a, these coefficient sequences 
will be in dual space, as noted above. Accordingly, 
process 134a begins with process 140 which, prior to 
spline -wavelet reconstruction, first transforms the . 
coefficient sequences »LL", -m-. "HL" and "HH" from dual 
space into spline space. Process 140 is preferably 
performed by way of the well-known CholesJcy computation 
method, given the duality principle as discussed above 
relative to equations (20) et seq. Subsequent passes 
through process 134a (i.e., when the result of decision 
135, described hereinbelow, indicates that the document 
was not fully reconstructed in a prior pass through 
process 134a) will not perform the transformation of 
process 140, as the coefficient sequences will already 
have been transformed into spline space. 



Upon completion of (or skipping) process 140, 
process 134a begins performing the inverse of 
decomposition process 48a described hereinabove. The 
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reconstruction of process i 3 * a ■ 

according to the recon^ ^ SffeCt °P e «tes 

convolved with reconstruct ° efflCient fences are 
<*>■ fences ( Pk) , 

will apply.. ■ L10Wln 3 "construction formula 



cr 1 = 



As noted above m„ 

resets by operatic, ^ o th ! nherenWj ' *— the 

convention procMs J * ~i- li*t., si„il arlv , 
results in an upsanpl 0 ? t Z T"™ " 4a 
equation (so) . 9 ' he results >V operation of 

^ cess 134 a are also taken ' 144 ln 

^cess x« eonvolves , \tt\e <! C ° 1U ' m "' i " "««*on. 
'«*■ co^onent. with "^-"^ ^""ion. the 

«^n=e {Pk) . whi P ch Zc:r 3tTUCti0 " °""**«t 

in process 48a h^TT^ 
<«) for the linear case th< " •'"""on 

— . ' tlUS Se9uence U) is defined 



(32) 
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The 1/4 terra may be applied to the resultant data later, 
allowing the convolution of process 142 to be performed' 
solely with integer values, in addition, the coefficient 
sequences -LL- and «LH» are inherently upsampled by a 
factor of two in the convolution of process 142, as noted 
above. The results of the two convolution operations of 
process 142 are summed into coefficient sequence {c^) . 

Similarly, process 144 is performed by way of which 
the »HL», "HH" component coefficient sequences are 
convolved, in column- wise fashion, with the 
reconstruction coefficient sequence {gj ; as noted above, 
reconstruction coefficient sequence {qj exactly equals 
decomposition sequence {bj used in the decomposition of 
the input document. For the linear case, the sequence 
{bj is specified in equation (33) as follows: 

^'^'^'^'V— (1.-6,10,-6,1), b k -0 for all other k 

(33) 

Again, the 1/24 division may be performed at a later 
time, to allow the convolution of process 144 to be 
performed using only integer values. This convolution 
will also effectively upsample the coefficient sequences 
as noted above, and the sum of the results of the two 
convolution operations of process 144 may be considered 
as coefficient sequence {d 3 * 1 }. 

The coefficient sequences {c^ 1 }, {d^ 1 } produced by 
the column-wise convolution of processes 142, 144 are 
then stored in image memory 167, in process 145. 
Referring back to Figure 9 for the example of a single 
pass decomposition and reconstruction, the coefficient 
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the manner ^ * 
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the decomposition sequences {aj , {b„j of equations (41) 
are used, incorporating the interpolatory spline function 
and its associated wavelet. 

As indicated hereinabove, and in contrast to the 
dual base wavelet reconstruction process 134b, the 
reconstruction coefficient sequences {p k ), {qj for the 
interpolatory approach are different from the 
decomposition sequences {a k }, {bj . Based on equation 
(42) described hereinabove, the reconstruction sequence 
(pj for the interpolatory wavelets will have p. x - h, p 0 = 
1, and Pl = with all other values of p equal to zero- 
and based on equation (37). the reconstruction sequence ' 
{qj wall have only a single non-zero element, namely q x - 
1, with all other values of q equal to zero. 

Figure 20 illustrates the operation of 
reconstruction process 134b according to the 
interpolatory wavelet technique. Process 152 retrieves 
coefficient sequences «LL", "LH", «HL» and «HH» from 
image memory 167; unlike process 134a, however, no 
transformation from dual space into spline space is 
required in this case, as no transformation into dual 
space was performed in the decomposition. 

The reconstruction of process 134b also operates 
according to the reconstruction tree of Figure 5b, in 
which the document component coefficient sequences are 
convolved with the reconstruction coefficient sequences 
{Pkh {<&} def ined hereinabove, according to the 
reconstruction formula of equation (50) hereinabove, in 
addition, just as the convolutions in decomposition 
process 48 inherently downsampled the results by 
operation of the summation limits; similarly, the 
convolution processes in reconstruction process 134b 
effectively upsample by operation of equation (50) . 
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161 when summed, is the coefficient sequence {=,), „ hich 
xs then stored in image memory 16, i„ process 163 

if c the io " I 35 • ,Pi9Ui r 17) ia then to 

case th 3 P ° int " e9Ual " 2ero " " 

case the document image has been fuliy reconstructed and 

processing win continue in the manner described 
hereinbelow. 



c . 



Waveler, packet- ^^^^,- Hnn 



For documents that were ri~~~ mr ^„„j 
wav of th 0 * t i . decomposed and compressed JOy 

way of the full-tree decomposition using wavelet packets 

Is ZlToZeTl' - tb. compressed loZll 

is performed by way of reconstruction process i 34 c which 
also operates according to wavelet packets. Wavelet 
packet reconstruction is governed by equation (49, : 



(49) 



TJ 1 tw « "~-truetlo« process, for two-dimensional 
data, thus wxll follow in the manner illustrated in 
Figure 21, which is the reverse of the full-tree 
decomposition of Figure Ha. As before the 
reconstruction of components into a high-frequency 
component reverses the spline and wavelet sequences., so 
that an reconstructing a high pass component in the next 
level, the high-pass component will be convolved with 
spline function coefficient reconstruction sequence { Pk} 
and the low-pass component will be convolved with wavelet 
function coefficient reconstruction sequence {*} 
Similarly, reconstruction process 134c is the reverse of 
decomposition process 134c described hereinabove 



WO 96/09718 



93 



PCT/US95/12050 



According to this embodiment of the inv.n- • 
for the wavelet oari^ ^ invention, and 

lnn „. C P acket decomposition sequences • 

Appendix A hereto m»Hn- * «quences listed m 

P lne fun ction coefficient 
reconstruction sequence "icient 
coeffi^,. ec ^ enc e {p,} and wavelet function 

coefficient reconstruction sequence ( a \ = 
Appendix B hereto. ^quence {qj are llsted in 

Referring now to Figures 22 and « 
components of the document . 

-th Pr0 ce SE 17d . in th 7: re et: n ;r ction be3ins 

,the particuiar document is read ^ ? ^ M » f ° r 
way. depressor 40 will oT / ""rpreted; in this 
-ponents of the dL^ LT^^T ^ 
can skip thoee components thaf! """"""^ and 

compassed document. TrlT, \ » ™ * 
:: iCh MP »" "'Sieves componen ^.1^7' 

^TuT for oonvolution Klth 

described, relative to the £1o! h " "°" be 

reconstruction tree ot ^ "f^ ^ » - 
be described in the case where aH 

no pruning of th!V components are present 

course, if the tree £ ^TIT' 1 - - « ' * 

-at certain component: ~ ^1^""* 
decomposition process 4R^ 

contempxated J t*"^£ e ^"~" ~ - 

Processes 171, 173 17c n-, • • 

» * -l/5, 177 initiate th*» 

reconstruction b, convoy the components in coiumn- 
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wise fashion. Specifically, process 171 convolves 
components {x} (the blur image,, { B), { A} , ^ {c) with 
spline reconstruction coefficient sequence {Pk , in column- 
wise fashion and process 173 convolves components ( H > ( 

' {L} ' {N) With wave ^ reconstruction coefficient 
sequence (q,) in column-wise fashion. Process 174 sums 
in paired fashion, the results of processes 171, i 73 to 
complete the upper-half (lower frequency) portion of the 
array in Figure 13d; convolved components {x} and {h} are 
summed into component {x} of Figure 13d, convolved 
components {b} and {j} are S ummed into component { B) of 
Figure 13d, convolved components { A) and {L ) are summed 
into component {a} of Figure 13d, and convolved 
components {c} and {«} are summed into component { C} of 
Figure 13d. 1 ' 



As described above in decomposition process 48c 
higher-frequency components were decomposed by 
convolution of the spline and wavelet sequences in 
reverse order. Reconstruction process 134c thus must 
reconstruct higher -frequency components by convolution of 
their respective low- and high-frequency components with 
the reconstruction sequences also in reverse order 
Process 175 thus convolves components ( D} , {E} , {P) ". and 
. ™ th WaV€l6t ^instruction coefficient sequence (*} 
m column-wise fashion, and process 177 convolves 
components {l}, { K } , < M} , (o} with spline reconstruction 
coefficient sequence { Pk} in column-wise fashion. Process 
174 sums, in paired fashion, the results of processes 
175, 172 to complete the lower-half (higher frequency, 
portion of the array in Figure 13d. As such, convolved 
components {D} and {1} are summed into component {d} of 
Figure 13d, convolved components {E} and (k) are summed 
into component { E) of Figure 13d, convolved components 
IF) and {M} are summed into component {f} of Figure 13d 
and convolved components {G} and {0} are summed into 
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component {G} of Figure n 

Process „, convolves ZlT Passes 17 6 , 

freouency components ,x "d mZZTL "* * l0 " er - 
components <E} and ( G ' " Jf ' ^ hi 3"er-frequen=y 

coefficient silence ",1, " " eo —™«« 
convoives each^f lower f'^ """^ «*« 

reconstruction coefficient «o , * ' h wavele t 

result of p.j::::^:^ *'- in — 

into co.pone n r ( c7r;t~ tS ~ 
convokes component s^ent tT^ 181 

w - j^r f ~~ -~ 

process 185 convoives ^' talf -™S'> • "milarty. . 
fashion with JeLt " W ln 

<*J and Process rcroTvrc"" """"^ ~ 
row-wise fashion with spUn7 Se9USnCS <=> in 

sequence {p J . Prooeos * \™ " c ° n «™ction coefficient 

Process 184 sums the result-- 
185, 187 into component sequence l A ) of p • 
the right-half -array, . * * Fl9Ure 13b (i ' e -< 
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The reconstruction operation of process 134c is 
completed, for this level of reconstruction, by the row- 
wise convolution of component sequence {X} with spline 
reconstruction coefficient sequence { Pk) in process 186> 
and by th e row-wise convolution of component sequence (a) 
with wavelet reconstruction coefficient sequence {*} in 
process 188. Process 190 sums the results of processes 
186, 188 into the document image {X}, and stores these 
results in image memory 167. 



di Completion of rAn ons tnirf 



ion 



Referring back to Figure 17, upon completion of the 
selected one of reconstruction processes 134a, i 34b 
134c, decision 135 is performed under the directions 
data controller 156 to determine if the document has been 
fully reconstructed according to the header compression 
information described hereinabove. For example, if the 
results of the completed process 134a, 134b, 134c returns 
a document that has a compression ratio, relative to the 
input document, of u, spline -wavelet reconstruction 
process 134 is complete and decision 135 will pass 
control to process 136. m contrast, if in compression 
the decomposition process 48 was repeated to further 
compress the document, and thus if the compression ratio 
of the document image at the end of process 134 (eg at 
the first pass therethrough) relative to the input 
document is greater than i:i, spline -wavelet ' 
reconstruction is not complete, and decision 135 will 
return control to dequantization process 132 for 
repetition of the appropriate spline-wavelet process 134. 

Upon full reconstruction being reached (decision 135 
returning a YES result) , DSP 160 passes the results to 
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data controller iss « 

» - — ^rr^t'T converter 

converter 32 i s «!„,,• la , figure l) . F 0rmat 

operations o£ byte eim,™ • Perform the lnv «se 
AS discussed above ^nT f0rma " in9 £ °* di ^*X- 
byte-paOced prio^o ^li ^ ^ been 
which case byte™ £ "—eiet degression, in 

* expansion process 13« will i~ 
to recover the docunent. As such ft necessary 

Perform the necessa^p^^ M 

infection transnatted^Tth^he d T' T ^ '° 
type of byte-packina „ T ttat lnd i«tes the 

Per pi*e/o £ Lt tLf "sT ^ — »» * 
document. Pormat converter 13 T""' 

conversion process l 38 • . Performs format 

accent is'refol ; T or TsT' ■ 

appropriate for the partfliar ! t " """"^ 

graphics display prfn^ P 

dec OBp ressed foL.^c 1 °2 Ut ' ""^ *» 

then collate, and the 'data LVbT SCrUCti ° n Pr °« SS *• 

desired manner. 7 Panted in the 



Coni-1i |ff i- n 



The methods and svat„. , 
-compressinc docament^ Its^T- 

specification rh.\ «"■*»»« *>W 

benefits ^J^lT"^ *»-— « 

looaiization of the Lut 
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in addition, the document image compression and 
decompression techniques according to the preferred 
embodiments of the invention, in using spline-wavelet 
functions that have compact support, avoid boundary 
effect artifacts in the compressed documents. By 
avoiding boundary effects, the present invention greatly 
improves the accuracy of the reconstructed compressed 
document (relative to the input document) , and also 
enables parallel processing (or computing) to be applied 
in the decomposition process by cutting the document into 
small pieces and, after reconstruction, piecing together 
the full image. Using the B-spline as the scaling 
function also provides display functions such as 
magnification and compression (»zoom-in» and "zoom-out") 
m the display of the reconstructed document. The 
usefulness of the reconstructed document, and thus the 
entire system, in allowing interactive display of the 
received or retrieved document is therefore much improved: 
over conventional document compression and decompression 
systems. 



In addition, it will have been appreciated that the 
present invention allows the compression and 
reconstruction operations to be done strictly with 
integer operations. As such, both compression and 
reconstruction operations according to the present 
invention may be done more efficiently, for a given 
compression ratio, than can conventional document 
compression and reconstruction processes. The ability to 
use integer operations also enables these processes to be 
performed with moderate performance data processing 
equipment, thus allowing wide-spread use of the present 
invention, as high-performance workstations are not 
necessarily required to practice the present invention. 
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^Tl^lzr^T ation aUows f ~ — 

cy ln lts "Pleraentation. 

While ehe invention ^ describe . . 

relative to its preferred .™k „ deBcrlbed herein 
'contested thaf m^l^T"' " * 

these embodiments, ^^1, ^"^ives to. 

<*tainin 3 the advan^^T" 8 "* 
-"1 be apparent to those of oT ° f lnVentiOT " 
having ref. rence to tt ° 8kiU th ° a " 

It is contemplated t ^ „T ' " "* dr "' in9S - 
alternatives are witMn t T 1C " i0M ^ 

auhsec.entiv eUimed °* ^ « 
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APPENDIX A 



m = 2 



m = 4 



*k + t 



b k + 1 



0.683012701892 0.866025403784 



0.893162856314 



-1.475394519892 



0.316987298108 -0316987298108 



0.400680825467 



0.468422596633 



-0.116025403784 -0.232050807569 



-0.282211870811 



0.742097698477 



-0.084936490539 0.084936490539 



-0.232924626134 



-0345770890775 



0.031088913246 0.062177826491 



0.1290983571218 



-0389745580800 



0.0222758664048 -0.022758664047 



0.126457446356 



0.196794277304 



-0.008330249198 -0.016660498395 



-0.066420837387 



0.207690838380 



8 | -0.006098165652 0.006098165652 



-0.067903608499 



-0.106775803373 



0.002232083545 0.004464167091 



0.035226101674 



-0.111058440711 



10 | 0.001633998562 -0.001633998561 



0.036373586989 



0.057330952254 



11 | -0.000598084983 -0.001196169967 



-0.018815686621 



0.059433388390 



12 1 -0.000437828595 0.000437828595 



■0.019473269356 



■0.030709700871 



13 I 0.000160256388 0.000320512777 



0.010066747520 



•0.031811811318 



14 [ 0.000117315818 -0.000117315818 



0.010424052187 



0.016440944687 



15 | -0.000042940569 -0.000085881139 



-0.005387929819 



0.017028029466 



16 1 -0.000031434679 0.000031434678 



-0.005579839208 



-0.008800839839 



17 | 0.000011505891 0.000023011782 



0.002883979478 



-0.009114745138 



18 0.000008422897 -0.000008422897 



0.002986784625 



0.004710957034 



19 1-0.000003082990 -0.000006165980 



0.001543728719 



0.004878941541 



20 I -0.000002256905 0.0000022569054 



-0.001598768083 



0.002521687975 



21 0.000000826079 0.0000016521587 



0.000826326663 



0.002611601542 
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WHAT IS ry^iMRn T| c . 



1. A method of compressing digital data 
representative of a document, comprising the steps of- 
formatting digital data corresponding to an 
image of the document into a two-dimensional array of 
digital values, each value corresponding to the 

r™:: the document at a — - - cation of 

dioifi f erf0rming 3 first ^composing of the array of 

I hll ' ln a first direction ' into 

and hxgh-freguency portions using a decomposition scaling 
function and a decomposition wavelet function 
respectively, said decomposition scaling and wavelet 
functions not requiring support outside of the array 
Q * , • OITnin9 3 SeC ° nd decom P° s ing of the results 

usina th I' d6COmPOSing °^ in • ™ direction, 
using the decomposition scaling and wavelet functions; 

communicating the results of the decomposing 
steps to a receiving unit. 

2. The method of claim 1, wherein said 
communicating step comprises: 

a memory. St ° rin9 ^ ° f ^ steps in 

3. The method of claim 1, wherein said 
communicating step comprises: s 

transmitting the results of the decomposing 
steps to a decompression system. 
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4. The method of claim 3 , further compris 

transmiteed resulce i t r s :j;r dlr r :i t tr ccin9 of 

reconstruction scaling function and . e " 10n ' usln * » 
wavelet function ..J , reconstruction 

^unction, said sealing and wavel.r *„.,....• 
requiring support outside of the aJay ^ 

reconstn,cLTs"7in a t h th :. reSUltS ° f ^ 
reconstruction 9 scaL, ^'.ST""' ^ °" 
wavelet function; and reconstruction 

«- re=onst~ft: p r" Ual ~« - * — - 

recoJ; ? 6 meCh ° d ° £ CUinl 4 ' Whe " i » <*• 
reconstruction scaling function is equal to the 

decomposition scaling function, and ^herei! th! 

reconstruction wavelet function is equaT 0 the 

decomposition wavelet function. 

6- The method of claim i * ^ 

oi ciaxm l, further comprising- 

values into P 7: u r Jpat t^T^ ° f 
decomposition scaling t haVi " 9 a *»* 

and wherein said first- 
are performed using ^Z^ZllZTZllZ ^ 
action and the dual decomposition wave!et f^L. 
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and wherein the decomposition wavelet function is 
the wavelet function corresponding to the centralized B- 
spline scaling function. 

8. The method of claim 1, wherein the decomposition 
scaling function and decomposition wavelet functions are 
based upon non-orthogonal, symmetric, spline-based 
wavelet packets. 



9. The method of claim l, wherein the first 
decomposing step comprises: 

(a) decomposing the array of digital values, ir 
the first direction, into low- frequency and high- 
frequency portions using the decomposition scaling 
function and the decomposition wavelet function, 
respectively; 

(b) decomposing the low- frequency portion from 
step (a) , in the first direction, into low-frequency and 
high-frequency portions using the decomposition scaling 
function and the decomposition wavelet function, 
respectively; and 

(c) decomposing the high-frequency portion from 
step (a) , in the first direction, into low- frequency and 
high-frequency portions using the decomposition wavelet 
function and the decomposition scaling function, 
respectively. 



10. The method of claim 9, wherein the second 
decomposing step comprises : 

(d) decomposing the results of the first 
decomposing step, in the second direction, into low- 
frequency and high-frequency portions using the 
decomposition scaling function and the decomposition 
wavelet function, respectively; 

(e) decomposing the low-frequency portion from 
step (d) , in the second direction, into low-frequency and 
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10 



15 



lt!l e lTL P °r i0nS USin9 d «^^ion scaling 
respect" t/" 0 ^" 10 " "^^ 

«- «ep ir t T s B f 9 , the hi9h - fr ^-=V portion fro. 



frequency co^ ^"ST?"' 

the lo„- freguency decomposition i„ ZTf ° £ 

the f irst deceasing sTep dire " i0n of 

hi^ency Cne~; ^I^onl * 
of the low-freau»i,rv ^ second direction, 

« «- «r S /:e™::x s ; tlOT in the £irst di — 

the high-fresuency decomposition^ J dl "««". •* 
<* the „« decomposing^; 0 ^" ^««io„ 

h^-frecuency ZZT^ '° 

directs of the £irst decomposlng 

»nd further comprising- ' 

to coTr:::^^- hl - and - =— — 

12 ' a T ?t e er th °! ° f Clalm 5 ' fUrCh6r 

co^unicatin" step B e^r tiZin? ^ "* Pri0r <° 
the ll. LH HI, and !T 9 l0Ssle " Session on 

^ HL, and HH components. 
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13. The method of claim 1, wherein said formatting 
step comprises: 

substituting at least first and second digital 
values for display attributes corresponding to the image 
of the document, to generate a substituted array of the 
at least first and second digital values; and 

after said substituting step, byte-packing the 
substituted array. 

14. The method of claim 13, wherein said 
substituting step first, second and third digital values 
for display attributes corresponding to the image of the 
document . 

15. A method of displaying compressed document 
image data, comprising: 

receiving compressed image data corresponding 
to a document and storing the compressed image data in 
memory, said compressed image data arranged as blur and 
high-frequency coefficient sequences; 

in a first image direction, applying a 
reconstruction scaling function and a reconstruction 
wavelet function to the compressed image data to 
reconstruct a low-frequency component and a high- 
frequency component; 

in a second image direction, applying the 
reconstruction scaling function and the reconstruction 
wavelet function to the reconstructed low- frequency 
component and high-frequency component to reconstruct the 
document image ; 

displaying the reconstructed document image. 

16. The method of claim 15, further comprising: 
repeating said steps of applying the 
reconstruction scaling function and the reconstruction 
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wavelet function in the first an H « 
direction Second im *sre 



directions 

17 



The method of claim is 

Derfnrm . , m 15 ' furt her comprising.- 

Performing lossless decompression on ^ 
compressed document image data , pri * r ^ " ^ . 
steps. *«-«-»r to said appl ying 

18. The method of claim k ..u 

19. The method of claim k fc u 

cxaim is, further comprisina- 

function and the d!al I *«itl« scaling 

=> the dual decomposition wavelet function. 

20- The method of claim is, wherein t-h. 
reconstruction scaling function sTltraiLd B , • 
scaling function; centralized B-spline 

«- watlet^tit lr nSt ™ C raVel " *• 

3 P iine acai^rfirtC ^ ondin9 to the centraii - a - 

21- The method of claim is, wherein th* ~ 
Pluralities of coefficient sequences, 

the ete P « fixing the reconstruction ' 



convolving the reconstruction scaling * «. . 
with the first plurality of coefficient ^ 
first direction; coefficient sequences, in the 
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10 convolving the reconstruction wavelet function 

with the second plurality of coefficient sequences, in 
the first direction; 

after the convolving steps, summing each of the 
first plurality of coefficient sequences to an associated 
15 one of the second plurality of coefficient sequences, to 
produce third and fourth pluralities of coefficient 
sequences ,- 

after the summing step, convolving the 
reconstruction scaling function with the third plurality 
of coefficient sequences, in the first direction; 

convolving the reconstruction wavelet function 
with the. fourth plurality of coefficient sequences, in 
the first direction; and 

then summing each of the third plurality of 
25 coefficient sequences to an associated one of the fourth 
plurality of coefficient sequences, to produce fifth and 
sixth pluralities of coefficient sequences; 

and wherein the step of applying the reconstruction 
scaling and wavelet functions in a second direction 
30 comprise: 

convolving the reconstruction scaling function 
with the fifth plurality of coefficient sequences, in the 
second direction; 

convolving the reconstruction wavelet function 
35 with the sixth plurality of coefficient sequences, in the 
second direction; 

after the convolving steps, summing each of the 
fifth plurality of coefficient sequences to an associated 
one of the sixth plurality of coefficient sequences, to 
40 produce a low- frequency component and a high-frequency 
component of the document image; 

after the summing step, convolving the 
reconstruction scaling function with the low-frequency 
component of the document image, in the second direction; 



45 
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with the jr^ 9 ^ reCOn8t -«-n wavelet function 

lcn cne ^9h- frequency component of t-h*» ^« 
in the second direction, and ~ U " ent 

f«Hn. n then SUmmin9 ^"V"** «d high- 

t ::rin c :r:: ts to produce an — — - - 

informs " inPUt SOUrCe f ° r -«9ital image 

information corresponding to a document to be 

communicated; and 

compressor circuitry having an input coupled to 
said input source, for decomposing each frame of digital 
image information in a first image direction, by 

iateger ^ image 

«vZt f USln9 3 8Calin3 £UnCti0 ° Md « corresponding 
the convolution interval, into a first low-frequency 

thin:::,^ 3 first hi * h -*~« ~^rjr,or 

Mqh frl deCO,nPOSin9 "= h <* low-fr.ou.ncy and 

high-frequency components of each frame of digital video 
«». information in a second image direction b" 
performing integer convolutions of the first low- 

flrtt IL , ""Ending wavelet function, into 

first and second pairs of low-frequency and second high- 
frequency components, said first pair being the 
decomposed representation of said first low-frequency 
component and said second pair corresponding to* 
decomposed representation of said first high-frequency 
component, said compressor circuitry also havingT 
output for presenting the ,i rst and second pairs of low- 
frequency and high-frequency components. 



23 



The system of claim 22. further comprising, 
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a format converter circuit coupled between said 
input source and said compressor, for converting the 
digital input video information into a portable gray- 
level format. 



24. The system of claim 23, wherein the format 
converter circuit comprises circuitry for byte-packing 

source . 



ri x, co "rcuicry tor byte -packing 
data corresponding to image data received from the input 



25. The system of claim 24, wherein said input 
source provides color document information; 

and wherein said byte-packing circuitry performs 
byte-packing of data containing more than one bit per 
picture element of the document. 

26. The system of claim 22, wherein said compressor 
circuitry comprises: 

decomposing circuitry for performing the 
decomposing of each frame of digital image information 
into the first and second pairs of low- frequency and 
high-frequency components; 

quantization circuitry for quantizing the high- 
frequency component of said first pair, and for 
quantizing the both the low-frequency and the high- 
frequency component of the second pair; and 

lossless compression circuitry, having an input 
coupled to said quantization circuitry, for performing 
lossless compression of the first and second low- 
frequency and high-frequency pairs, prior to presenting 
the decomposed frames of digital video image information 
at the output of the compressor circuitry. 

27. The system of claim 26, further comprising: 

main controller circuitry, for controlling the 
operation of the decomposing circuitry, so that the low- 
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frequency component of said first pair may be 
repet iti ly provided ^ ^ decomp 

further decomposing. ^ 

cir=u!trv f SySte '" ° f Claim " hereln 8Sid lessor 

circuitry comprises: 

an image buffer coupled to the input of the 
pressor circuitry for storing a frame of digital video 
image information; and <"3«al video 

a digital processor for performing the 

in'toTf" 3 ° £ eaCh £ra " e ° £ dlSltal ^ formation 
into the f lrst Md secMd pairs Qf lQw . fr 

high-frequency components by performing integer 
convolutions of the digital image information using a 
Zl Z IT ^ 3 CO ""«* -velet function 
i™ reqU " e SUPPO " ° UCSide ° f «- convolution 



interval . 
29. 



The system of claim 28, wherein said digital 

zzri r p r ates according to ^ ^uj^ 

precalcuiated matrices corresponding to spline and 
wavelet function coefficient sequences stored in said 
compressor circuitry. 

30. The system of claim 19, further comprising- 

a communications network coupled to the output 
of the compressor circuitry; 

to «,M deC ° mPreSSOr = ir cuitry. having an input coupled 
to said communications network, for reconstructing the 
decomposed digital image information in the second image 
direction by performing integer convolutions of the 

TIT 1 in£ormation * reconstruction scaling 

function and a corresponding reconstruction wavelet 
function that do not retire support outside of the 
convolution interval, for then further reconstructing the 
digital image information in the first image direction by 
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performing integer convolutions of the digital image 
information using the reconstruction scalL .J , 
functions; and waling and wavelet 

means for displaying the reconstructed frames 
of digital image information. 

31. A system for displaying compressed image data 
corresponding to a document, comprising: 

• memory tor storing the compressed image data- 
decompressor circuitry for reconstructing the ' 
compressed image data in a first image direction by 

LforTtT lntSger C ° nVOlUtionS ° f «" ^tal image 
information using a reconstruction scaling function an* 
corresponding reconstruction wavelet t^£^£^ 
require support outside of the convolution inte^al and 
for t h en further reconstructing the compressed i^ ^ 
m a second image direction oy performing integer 
convolutions of the digital image information using the : 
reconstruction scaling and wavelet functions; and 

means, coupled to said decompressor circuitry 
for outputting the reconstructed compressed image dat Z' 

coupled'to 7116 SyStem ° f CUim 31 ' WherSin Said «— ry is 
coupled to a communications network. 

33. The system of claim 31, wherein said 
decompressor circuitry comprises: 

a digital processor coupled to said memory for 
reconstructing the dicrital i ma «« memory, for 

s «« aigicai image information usino 
precalculated matrices of integers 
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